-- Logs begin at Thu 2022-02-03 02:17:15 UTC, end at Thu 2022-02-03 03:14:38 UTC. -- Feb 03 02:48:21.534662 dv-cinder-827581-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 03 02:48:21.544252 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 03 02:48:21.547328 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Feb 3 02:48:21 2022] *** Feb 03 02:48:21.547328 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 03 02:48:21.547328 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 03 02:48:21.547328 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: nodename: dv-cinder-827581-1-iscsi Feb 03 02:48:21.547328 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: machine: x86_64 Feb 03 02:48:21.547328 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: clock source: unix Feb 03 02:48:21.547328 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: pcre jit disabled Feb 03 02:48:21.547328 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: detected number of CPU cores: 4 Feb 03 02:48:21.547328 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: current working directory: / Feb 03 02:48:21.547328 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: detected binary path: /usr/bin/uwsgi-core Feb 03 02:48:21.547328 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: your processes number limit is 47680 Feb 03 02:48:21.547328 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: your memory page size is 4096 bytes Feb 03 02:48:21.547328 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: detected max file descriptor number: 2048 Feb 03 02:48:21.547328 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: lock engine: pthread robust mutexes Feb 03 02:48:21.548193 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: thunder lock: enabled Feb 03 02:48:21.548193 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 03 02:48:21.548193 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 03 02:48:21.591518 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: Python main interpreter initialized at 0x556755bbd9c0 Feb 03 02:48:21.591518 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: python threads support enabled Feb 03 02:48:21.591518 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: your server socket listen backlog is limited to 100 connections Feb 03 02:48:21.591518 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: your mercy for graceful operations on workers is 90 seconds Feb 03 02:48:21.591899 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: mapped 403077 bytes (393 KB) for 2 cores Feb 03 02:48:21.591899 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: *** Operational MODE: preforking *** Feb 03 02:48:21.592171 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: *** uWSGI is running in multiple interpreter mode *** Feb 03 02:48:21.592171 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: spawned uWSGI master process (pid: 101743) Feb 03 02:48:21.594740 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: spawned uWSGI worker 1 (pid: 101744, cores: 1) Feb 03 02:48:21.594740 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: spawned uWSGI worker 2 (pid: 101745, cores: 1) Feb 03 02:48:21.594740 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 03 02:48:21.592377 dv-cinder-827581-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 03 02:48:23.338304 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 03 02:48:23.338304 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: from cryptography.utils import int_from_bytes Feb 03 02:48:23.338986 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 03 02:48:23.338986 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: from cryptography.utils import int_from_bytes Feb 03 02:48:23.342637 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 03 02:48:23.342637 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: from cryptography.utils import int_from_bytes Feb 03 02:48:23.343184 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 03 02:48:23.343184 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: from cryptography.utils import int_from_bytes Feb 03 02:48:25.891506 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 03 02:48:25.892061 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 03 02:48:25.892175 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 03 02:48:25.892175 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 03 02:48:25.892581 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 03 02:48:25.892581 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 03 02:48:25.892758 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 03 02:48:25.892841 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 03 02:48:25.893025 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 03 02:48:25.893225 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.893367 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 03 02:48:25.893527 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.893708 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.893862 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.894040 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.894162 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.894307 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.894459 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.894668 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.894813 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.894951 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.895077 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.895287 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.895419 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.895594 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.895701 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.895931 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.896074 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.896261 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.896392 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.896500 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.896594 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-827581-1-iscsi {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.896850 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.897028 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.897144 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-827581-1-iscsi {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.897237 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.897489 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.897628 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.897804 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.897943 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.898118 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.898242 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.898372 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.898455 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.898696 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.898827 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.899022 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.899180 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.899291 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.900368 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.900503 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.900633 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.900765 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.900859 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.901003 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.901084 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.901211 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.901299 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.901386 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.901470 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.901561 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.901639 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.901759 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.901846 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.901976 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.902063 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.902267 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.902356 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.902590 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.902733 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-827581-1-iscsi {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.902867 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.903049 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.903280 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-827581-1-iscsi {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.903427 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.903596 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.903685 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.903896 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.904025 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.904215 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.904334 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.904625 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.904830 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.904974 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.905103 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.905282 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.905370 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.905588 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.905688 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.905914 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.906009 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.906219 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.906313 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.906535 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.906631 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.906849 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.906937 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.907147 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.907240 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.907450 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.907548 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.907756 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.907850 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.908061 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.908150 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.908361 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.908489 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.908653 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.908759 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.908929 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.909015 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.909238 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.909338 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.909503 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.909588 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.909813 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.909898 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.910135 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.910220 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.910404 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.910490 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.910653 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.910753 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.910970 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.911070 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.911231 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.911331 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.911546 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.911639 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.911866 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.911950 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.912170 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.912252 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.912476 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.912569 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.912806 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.912904 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.913111 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.913195 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.913416 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.913506 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.913720 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.913803 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.914025 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.914158 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.914333 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.914420 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.914650 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.914739 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.914958 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.915050 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.915273 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.915357 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.915633 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.915722 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.915952 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.916046 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.916257 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.916346 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.916585 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.916670 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.916921 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.917017 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.917231 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.917324 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.917548 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.917632 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.917859 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.917943 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.918164 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.918257 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.918470 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.918597 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.918777 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.918862 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.919091 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.919184 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.919394 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.919479 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.919701 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.919785 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.919949 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.920035 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.920249 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.920341 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.920553 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.920639 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.920896 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.920984 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.921205 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.921301 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.921511 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.921604 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.921816 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.921900 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.922116 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.922213 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.922422 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.922507 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.922727 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.922818 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.923030 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.923131 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.923337 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.923421 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.923640 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.923730 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.923942 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.924034 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.924247 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.924373 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.924549 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.924632 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.924877 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.924976 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.925185 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.925269 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.925494 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.925578 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.925797 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.925887 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.926100 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.926190 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.926404 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.926488 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.926708 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.926802 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.927014 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.927107 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.927315 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.927399 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.927619 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.927716 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.927931 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.928014 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.928231 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.928322 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.928542 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.928673 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.928869 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.928966 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.929172 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.929256 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.929476 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.929570 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.929782 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.929865 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.930089 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.930187 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.930386 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.930474 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.930684 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.930767 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.931007 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.931089 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.931316 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.931402 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.931618 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.931708 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.931922 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.932005 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.932223 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.932316 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.932525 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.932608 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.932847 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.932945 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.933152 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.933237 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.933449 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.933532 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.933753 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.933844 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.934053 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.934141 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.934360 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.934485 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.934665 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.934762 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.934969 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.935053 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.935273 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.935357 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.935580 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.935677 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.935901 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:48:25.935992 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.936237 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.936321 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.936546 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.936637 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.936901 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.936990 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.937220 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.937303 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.937537 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.937624 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.937847 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.937938 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.938161 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.938244 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.938476 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.938559 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.938796 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.938883 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.939098 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.939190 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.939408 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.939502 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.939716 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.939799 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.940028 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.940120 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.940344 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.940433 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.940656 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.940850 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.941007 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.941105 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.941321 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.941406 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.941628 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.941712 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.941941 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.942034 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.942251 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.942336 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.942568 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.942659 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.942876 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.942991 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.943211 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.943306 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.943543 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.943626 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.943849 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.943944 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.944173 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.944258 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.944483 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.944574 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.944830 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.944919 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.945145 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.945228 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.945453 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.945536 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.945767 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.945854 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.946075 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.946161 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.946389 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.946474 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.946773 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.946857 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.947089 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.947182 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.947404 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.947520 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.947753 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.947841 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.948060 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.948157 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.948364 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.948459 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.948672 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.948772 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.949003 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.949100 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.949304 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.949397 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.949612 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.949696 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.949916 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.950001 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.950229 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.950321 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.950549 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.950634 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.950850 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.950933 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.951156 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.951252 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.951464 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.951549 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.951773 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.951862 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.952080 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.952165 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.952385 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.952470 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.952689 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.952835 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.953023 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.953118 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.953336 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.953420 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.953643 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.953729 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.953945 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.954030 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.954267 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.954350 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.954569 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.954692 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.954873 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.954959 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.955182 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.955271 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.955488 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.955585 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.955797 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.955882 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.956109 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.956200 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.956425 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.956516 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.956753 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.956841 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.957071 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.957155 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.957380 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.957472 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.957695 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.957788 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.958004 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.958087 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.958329 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.958425 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.958631 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.958720 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.958955 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.959082 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.959256 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.959357 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.959564 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.959648 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.959868 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.959952 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.960168 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.960259 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.960469 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.960560 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.960798 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.960883 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.961101 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.961192 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.961405 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.961496 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.961703 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.961787 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.962002 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.962093 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.962326 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.962410 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.962633 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.962717 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.962933 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.963018 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.963234 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.963317 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.963535 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.963627 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.963836 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.963919 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.964136 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.964226 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.964440 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.964534 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.964807 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.964907 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.965112 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.965198 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.965438 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.965530 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.965758 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.965842 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.966069 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.966205 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.966382 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.966476 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.966692 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.966776 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.967001 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.967083 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.967308 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.967393 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.967618 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.967701 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.967924 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.968015 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.968229 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.968314 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.968547 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.968638 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.968879 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.968964 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.969198 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.969283 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.969502 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.969591 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.969820 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.969905 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.970121 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.970207 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.970436 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.970528 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.970735 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.970826 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.971052 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.971136 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.971391 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.971474 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.971702 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.971794 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.972012 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.972096 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.972324 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.972408 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.972631 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.972770 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.972962 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.973046 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.973270 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.973362 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.973577 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.973670 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.973884 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.973968 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.974189 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.974273 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.974502 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.974593 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.974807 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.974890 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.975121 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.975207 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.975426 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.975511 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.975741 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.975833 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.976042 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.976132 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.976352 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.976445 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.976650 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.976753 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.976987 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.977072 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.977310 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.977395 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.977620 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.977705 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.977987 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.978070 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.978303 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.978390 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.978612 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.978701 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.978918 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.979010 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.979218 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.979302 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.979522 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.979607 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.979824 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.979917 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.980129 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.980214 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.980432 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.980515 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.980760 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.980859 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.981065 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.981153 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.981375 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.981459 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.982051 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.982215 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.982357 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.982453 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.982659 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.982743 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.982959 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.983050 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.983260 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.983370 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.983569 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.983661 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.983884 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.983969 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.984193 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.984284 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.984492 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.984583 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.984819 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.984994 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.985139 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.985300 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.985454 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.985603 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.985757 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.985923 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.986056 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.986236 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.986356 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.986540 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.986692 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.986843 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.987000 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.987146 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.987303 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.987484 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.987615 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.987799 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.987935 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.988100 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.988242 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.988414 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.988557 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.988753 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.988894 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.989071 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.989202 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.989383 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.989521 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.989694 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.989831 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.990003 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.990137 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.990323 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.990445 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.990638 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.990766 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.990948 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.991074 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.991261 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.991380 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.991572 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.991697 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.991883 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.992005 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.992195 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.992312 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.992515 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.992620 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.992853 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.992951 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.993171 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.993256 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.993497 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.993731 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.993821 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.994107 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.994237 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.994423 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.994515 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.994733 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.994988 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.995080 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.995325 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.995410 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.995646 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.995730 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.995967 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.996051 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.996290 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.996374 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.996598 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.996681 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.996931 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.997019 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.997248 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.997332 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.997548 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.997641 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.997850 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.997934 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.998164 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.998295 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.998465 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.998569 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.998778 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.998865 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.999067 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.999159 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.999373 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.999482 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.999674 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.999779 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:25.999975 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.000059 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.000285 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.000379 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.000582 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.000679 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.000916 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.001003 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.001216 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.001310 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.001517 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.001614 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.001815 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.001900 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.002117 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.002207 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.002422 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.002516 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.002721 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.002813 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.003016 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.003100 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.003315 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.003410 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.003623 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.003707 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.003926 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.004017 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.004229 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.004322 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.004560 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.004643 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.004890 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.004976 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.005214 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.005309 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.005511 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.005595 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.005831 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.005922 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.006133 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.006221 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.006433 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.006524 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.006734 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.006833 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.007038 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.007122 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.007340 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.007424 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.007637 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.007729 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.007944 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.008028 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.008253 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.008348 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.008551 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.008643 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.008882 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.008968 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.009233 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.009332 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.009547 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.009651 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.009845 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.009937 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.010145 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.010236 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.010448 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.010540 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.010748 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.010840 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.011045 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.011129 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.011350 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.011437 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.011650 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.011733 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.011945 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.012028 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.012250 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.012342 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.012548 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.012633 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.012873 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.012960 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.013171 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.013257 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.013470 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.013556 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.013772 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.013856 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.014071 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.014155 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.014375 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.014467 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.014673 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.014770 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.014980 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.015065 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.015292 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.015389 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.015589 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.015681 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.015886 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.015970 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.016192 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.016276 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.016493 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.016586 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.016816 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.016913 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.017124 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.017207 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.017425 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.017521 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.017734 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.017818 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.018030 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.018119 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.018338 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.018434 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.018643 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.018728 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.018942 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.019024 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.019240 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.019325 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.019539 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.019622 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.019835 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.019929 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.020132 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.020224 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.020432 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.020515 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.020753 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.020838 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.021050 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.021134 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.021350 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.021433 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.021661 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.021753 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.021963 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.022055 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.022264 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.022348 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.022564 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.022656 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.022909 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.022995 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.023219 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.023310 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.023528 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.023621 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.023864 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.023947 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.024173 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.024256 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.024486 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.024577 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.024838 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.024926 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.025149 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.025232 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.025463 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.025558 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.025768 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.025852 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.026076 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.026161 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.026384 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.026469 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.026687 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.026778 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.026986 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.027083 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.027287 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.027373 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.027601 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.027685 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.027904 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.027988 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.028209 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.028295 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.028530 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.028631 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.028860 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.028981 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.029173 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.029259 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.029471 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.029555 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.029783 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.029876 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.030094 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.030178 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.030394 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.030539 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.030699 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.030791 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.031006 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.031089 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.031312 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.031405 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.031623 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.031715 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.031931 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.032014 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.032239 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.032323 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.032547 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.032640 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.032882 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.032966 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.033192 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.033278 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.033498 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.033590 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.033797 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.033880 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.034103 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.034186 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.034411 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.034499 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.034710 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.034801 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.035014 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.035096 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.035317 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.035402 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.035619 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.035721 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.035917 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.036007 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.036221 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.036341 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.036534 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.036636 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.036860 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.036964 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.037271 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.037357 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.037579 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.037664 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.037890 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.037987 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.038193 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.038276 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.038520 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.038656 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.038843 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.038984 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.039118 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.039202 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.039430 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.039517 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.039733 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.039826 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.040088 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.040175 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.040450 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.040534 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.040788 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.040887 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.041102 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.041186 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.041404 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.041522 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.041707 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.041794 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.042008 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.042090 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.042310 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.042401 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.042616 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.042700 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.042916 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.043000 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.043216 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.043306 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.043536 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.043622 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.043839 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.043924 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.044159 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.044251 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.044570 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.044655 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.044905 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.044992 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.045210 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.045307 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.045530 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.045722 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.045848 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.045933 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.046177 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.046271 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.046483 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.046567 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.046793 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.046877 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.047105 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.047201 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.047427 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.047518 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.047744 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.047827 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.048051 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.048144 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.048363 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.048447 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.048668 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.048788 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.049015 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.049109 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.049327 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.049417 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.049630 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.049723 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.049944 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.050035 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.050261 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.050346 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.050573 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.050658 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.050893 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.050987 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.051250 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.051341 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.051573 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.051658 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.051875 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.051958 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.052195 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.052289 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.052482 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.052567 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.052809 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.052909 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.053112 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.053204 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.053421 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.053519 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.053720 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.053813 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.054019 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.054104 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.054324 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.054407 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.054627 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.054719 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.054926 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.055010 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.055225 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.055315 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.055528 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.055623 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.055831 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.055933 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.056152 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.056236 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.056468 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.056554 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.056797 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.056882 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.057118 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.057202 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.057419 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.057513 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.057736 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.057827 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.058043 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.058127 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.058344 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.058430 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.058649 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.058732 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.058949 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.059043 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.059250 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.059335 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.059553 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.059638 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.059857 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.059954 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.060183 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.060266 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.060486 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.060570 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.060824 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.060924 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.061154 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.061246 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.061476 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.061567 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.061785 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.061877 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.062097 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.062180 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.062417 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.062503 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.062720 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.062814 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.063021 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.063105 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.063329 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.063462 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.063629 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.063720 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.063928 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.064011 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.064229 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.064312 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.064530 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.064615 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.064854 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.064941 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.065160 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.065255 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.065459 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.065544 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.065759 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.065857 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.066064 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.066164 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.066360 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.066452 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.066673 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.066782 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.068757 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.068900 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.068900 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.069047 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.069115 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.069181 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.069247 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.069321 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.069389 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.069462 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.069462 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.069583 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.069648 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.069725 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.069793 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.069867 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.069935 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.070001 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.070066 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.070141 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.070207 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.070273 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.070338 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.070411 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.070647 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.070736 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.070957 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.071040 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.071260 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.071341 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.071565 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.071719 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.071933 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.072025 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.072238 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.072322 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.072548 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.072642 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.072883 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.072986 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.073195 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.073296 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.073504 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.073595 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.073818 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.074020 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.074116 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.074346 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.074444 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.074658 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.074968 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.075115 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.075267 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.075373 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.075606 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.075737 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.075912 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.076042 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.076218 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.076361 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.076530 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.076660 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.076862 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.077009 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.077150 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.077248 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.077471 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.077608 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.077788 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.077881 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.078099 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.078193 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.078423 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.078518 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.078715 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.078852 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.079011 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.079161 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.079303 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.079442 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.079592 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.079744 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.079964 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.080121 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.080274 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.080414 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.080553 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.080772 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.080922 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.081061 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.081203 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.081342 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.081494 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.081643 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.081783 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.081921 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.082071 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.082216 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.082363 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.082503 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.082643 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.082788 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.082958 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.083114 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.083263 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.083403 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.083547 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.083790 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.084398 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.084484 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.084570 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.084650 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.084650 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.084844 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.084933 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.085015 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.085094 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.085172 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.085406 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.085501 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.085716 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.085813 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.086025 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.086233 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.086375 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.086550 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.086639 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.086878 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.087138 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.087249 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.087470 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.087565 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.087803 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.087892 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.088124 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.088217 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.088446 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.088546 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.088769 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.088859 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.089075 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.089159 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.089386 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.089484 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.089692 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.089777 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.089992 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.090077 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.090303 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.090401 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.090611 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.090696 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.090912 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.090995 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.091226 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.091314 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.091533 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.091617 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.091836 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.092058 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.092157 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.092405 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.092553 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.092734 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.092988 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.093075 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.093337 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.093423 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.093654 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.093738 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.093962 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.094056 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.094322 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.094457 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.094581 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.094666 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.094884 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.094977 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.095196 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.095280 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.095499 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.095582 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.095798 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.095890 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.096099 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.096191 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.096402 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.096533 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.096707 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.096822 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.097031 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.097116 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.097340 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.097425 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.097643 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.097726 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.097982 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.098074 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.098251 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.098343 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.098555 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.098640 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.098853 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.098938 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.099163 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.099247 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.099468 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.099554 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.099764 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.099849 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.100068 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.100152 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.100371 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.100456 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.100672 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.100784 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.100996 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.101268 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.101369 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.101448 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.101596 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.101688 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.101900 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.101996 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.102197 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.102282 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.102500 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.102584 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.102797 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.102909 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.103151 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.103248 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.103464 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.103550 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.103767 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.103863 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.104076 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.104163 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.104377 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.104461 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.104681 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.104822 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.105012 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.105096 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.105318 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.105401 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.105640 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.105726 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.105954 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.106042 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.106266 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.106873 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.106972 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.107212 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.107298 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.107538 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.107847 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.107943 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.108187 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.108273 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.108499 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.108594 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.108837 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.109005 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.109143 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.109233 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.109464 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.109549 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.109773 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.109872 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.110078 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.110161 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.110387 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.110471 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.110696 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.110788 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.111005 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.111089 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.111313 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.111398 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.111619 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.111706 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.111926 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.112018 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.112233 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.112317 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.112541 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.112638 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.112874 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.112961 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.113192 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.113277 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.113492 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.113585 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.113806 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.113899 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.114123 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.114217 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.114434 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.114517 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.114748 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.114833 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.115056 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.115152 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.115361 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.115445 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.115664 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.115749 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.115969 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.116129 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.116275 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.116358 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.116583 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.116693 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.116918 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.117045 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.117222 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.117306 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.117556 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.117643 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.117872 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.117995 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.118179 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.118263 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.118569 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.118655 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.118880 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.118974 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.119198 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.119290 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.119514 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.119610 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.119823 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.119909 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.120139 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.120223 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.120447 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.120538 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.120780 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.120867 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.121104 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.121189 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.121418 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.121519 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.121742 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.121826 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.122048 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.122132 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.122349 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.122442 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.122650 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.122785 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.122958 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.123100 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.123292 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.123407 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.123623 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.123707 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.123937 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.124028 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.124257 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.124343 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.124567 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.124651 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.124928 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.125013 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.125238 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.125332 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.125559 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.125645 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.125881 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.125964 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.126191 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.126276 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.126501 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.126591 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.126817 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.126912 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.127130 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.127221 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.127439 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.127522 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.127748 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.127846 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.128059 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.128143 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.128373 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.128457 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.128684 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.128815 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.129032 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.129130 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.129336 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.129431 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.129641 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.129726 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.129964 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.130049 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.130281 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.130373 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.130587 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.130671 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.130901 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.130986 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.131210 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.131294 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.131527 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.131618 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.131843 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.131983 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.132183 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.132288 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.132457 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.132541 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.132795 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.132895 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.133112 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.133209 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.133424 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.133511 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.133736 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.133822 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.134056 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.134169 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.134429 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.134523 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.134749 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.134834 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.135073 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.135167 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.135390 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.135477 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.135714 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.135798 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.136043 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.136138 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.136354 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.136440 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.136665 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.136777 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.136994 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.137082 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.137243 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 03 02:48:26.137391 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.137636 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.137944 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:48:26.138188 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 03 02:48:26.160899 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG oslo_db.sqlalchemy.engines [None req-1bc1298a-9d5f-407c-be6a-907479d25be3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101744) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 03 02:48:26.161917 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG oslo_db.sqlalchemy.engines [None req-93f76668-ce5a-4bed-ba94-881b8cf10e1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 03 02:48:26.222896 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.context [None req-1bc1298a-9d5f-407c-be6a-907479d25be3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),40cf0a47-7e1e-4d6b-9709-06f3170571bd(cell1) {{(pid=101744) load_cells /opt/stack/nova/nova/context.py:464}} Feb 03 02:48:26.224040 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.context [None req-93f76668-ce5a-4bed-ba94-881b8cf10e1f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),40cf0a47-7e1e-4d6b-9709-06f3170571bd(cell1) {{(pid=101745) load_cells /opt/stack/nova/nova/context.py:464}} Feb 03 02:48:26.227104 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG oslo_concurrency.lockutils [None req-1bc1298a-9d5f-407c-be6a-907479d25be3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:48:26.228260 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG oslo_concurrency.lockutils [None req-93f76668-ce5a-4bed-ba94-881b8cf10e1f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:48:26.228815 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG oslo_concurrency.lockutils [None req-1bc1298a-9d5f-407c-be6a-907479d25be3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:48:26.229553 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG oslo_concurrency.lockutils [None req-1bc1298a-9d5f-407c-be6a-907479d25be3 None None] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:48:26.229865 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG oslo_concurrency.lockutils [None req-93f76668-ce5a-4bed-ba94-881b8cf10e1f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:48:26.230670 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG oslo_concurrency.lockutils [None req-93f76668-ce5a-4bed-ba94-881b8cf10e1f None None] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:48:26.231471 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG oslo_concurrency.lockutils [None req-1bc1298a-9d5f-407c-be6a-907479d25be3 None None] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:48:26.232992 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG oslo_concurrency.lockutils [None req-93f76668-ce5a-4bed-ba94-881b8cf10e1f None None] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101745) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:48:26.242822 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG oslo_db.sqlalchemy.engines [None req-1bc1298a-9d5f-407c-be6a-907479d25be3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101744) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 03 02:48:26.245686 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG oslo_db.sqlalchemy.engines [None req-1bc1298a-9d5f-407c-be6a-907479d25be3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101744) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 03 02:48:26.248758 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG oslo_db.sqlalchemy.engines [None req-93f76668-ce5a-4bed-ba94-881b8cf10e1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 03 02:48:26.251280 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG oslo_db.sqlalchemy.engines [None req-93f76668-ce5a-4bed-ba94-881b8cf10e1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 03 02:48:26.402509 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG oslo_db.sqlalchemy.engines [None req-1bc1298a-9d5f-407c-be6a-907479d25be3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101744) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 03 02:48:26.408046 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG oslo_db.sqlalchemy.engines [None req-93f76668-ce5a-4bed-ba94-881b8cf10e1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 03 02:48:26.739588 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: WARNING keystonemiddleware.auth_token [None req-1bc1298a-9d5f-407c-be6a-907479d25be3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 03 02:48:26.741064 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: WARNING keystonemiddleware.auth_token [None req-93f76668-ce5a-4bed-ba94-881b8cf10e1f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 03 02:48:26.746310 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: WARNING keystonemiddleware.auth_token [None req-1bc1298a-9d5f-407c-be6a-907479d25be3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 03 02:48:26.747648 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: WARNING keystonemiddleware.auth_token [None req-93f76668-ce5a-4bed-ba94-881b8cf10e1f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 03 02:48:27.085909 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: WARNING keystonemiddleware.auth_token [None req-1bc1298a-9d5f-407c-be6a-907479d25be3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 03 02:48:27.086812 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: WARNING keystonemiddleware.auth_token [None req-93f76668-ce5a-4bed-ba94-881b8cf10e1f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 03 02:48:27.091382 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: WARNING keystonemiddleware.auth_token [None req-1bc1298a-9d5f-407c-be6a-907479d25be3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 03 02:48:27.092157 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: WARNING keystonemiddleware.auth_token [None req-93f76668-ce5a-4bed-ba94-881b8cf10e1f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 03 02:48:27.096549 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556755bbd9c0 pid: 101744 (default app) Feb 03 02:48:27.097319 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556755bbd9c0 pid: 101745 (default app) Feb 03 02:48:27.098645 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-1bc1298a-9d5f-407c-be6a-907479d25be3 None None] Calling method '>' {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:48:27.099813 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-1bc1298a-9d5f-407c-be6a-907479d25be3 None None] 10.222.0.31 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001734 Feb 03 02:48:27.100212 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 1/1] 10.222.0.31 () {50 vars in 788 bytes} [Thu Feb 3 02:48:27 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:49:51.960157 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-93f76668-ce5a-4bed-ba94-881b8cf10e1f None None] Calling method '>' {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:49:51.961648 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-93f76668-ce5a-4bed-ba94-881b8cf10e1f None None] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002297 Feb 03 02:49:51.962047 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 1/2] 10.222.0.31 () {54 vars in 930 bytes} [Thu Feb 3 02:49:51 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:49:52.385415 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-e9ce37de-1b53-4495-8fc1-a8379bacfdca admin admin] Calling method '>' {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:49:52.415049 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-e9ce37de-1b53-4495-8fc1-a8379bacfdca admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.446958 Feb 03 02:49:52.415710 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 2/3] 10.222.0.31 () {60 vars in 1291 bytes} [Thu Feb 3 02:49:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:49:54.668241 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-93f76668-ce5a-4bed-ba94-881b8cf10e1f None None] Calling method '>' {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:49:54.669275 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-93f76668-ce5a-4bed-ba94-881b8cf10e1f None None] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Feb 03 02:49:54.669676 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 2/4] 10.222.0.31 () {54 vars in 930 bytes} [Thu Feb 3 02:49:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:49:54.730370 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-9166c161-bf79-4754-a4c0-981847de6743 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "disk": 1, "ram": 256, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "id": "c1"}} {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:49:54.748309 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:49:54.748309 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: warnings.warn(msg) Feb 03 02:49:54.777440 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-9166c161-bf79-4754-a4c0-981847de6743 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.101922 Feb 03 02:49:54.780790 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 3/5] 10.222.0.31 () {64 vars in 1282 bytes} [Thu Feb 3 02:49:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 03 02:49:55.013124 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-f941bfe3-ae87-4a24-91e1-6e34c976b62a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:49:55.015797 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:49:55.015797 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: warnings.warn(msg) Feb 03 02:49:55.067748 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-f941bfe3-ae87-4a24-91e1-6e34c976b62a admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.281261 Feb 03 02:49:55.069012 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 3/6] 10.222.0.31 () {64 vars in 1335 bytes} [Thu Feb 3 02:49:54 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:49:57.276345 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-9166c161-bf79-4754-a4c0-981847de6743 admin admin] Calling method '>' {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:49:57.277472 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-9166c161-bf79-4754-a4c0-981847de6743 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Feb 03 02:49:57.278044 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 4/7] 10.222.0.31 () {54 vars in 930 bytes} [Thu Feb 3 02:49:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:49:57.384468 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-9666d184-e796-4b63-a6b3-1ffc6593ae2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "id": "d1", "vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "disk": 5, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:49:57.407367 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:49:57.407367 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: warnings.warn(msg) Feb 03 02:49:57.423638 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-9666d184-e796-4b63-a6b3-1ffc6593ae2f admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140108 Feb 03 02:49:57.424210 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 4/8] 10.222.0.31 () {64 vars in 1282 bytes} [Thu Feb 3 02:49:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 03 02:49:57.436355 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-009e8205-7084-49d9-b933-89ee453b087c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:49:57.437975 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:49:57.437975 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: warnings.warn(msg) Feb 03 02:49:57.471737 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-009e8205-7084-49d9-b933-89ee453b087c admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039107 Feb 03 02:49:57.472953 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 5/9] 10.222.0.31 () {64 vars in 1335 bytes} [Thu Feb 3 02:49:57 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:49:59.714562 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-9666d184-e796-4b63-a6b3-1ffc6593ae2f admin admin] Calling method '>' {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:49:59.715769 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-9666d184-e796-4b63-a6b3-1ffc6593ae2f admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001700 Feb 03 02:49:59.716621 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 5/10] 10.222.0.31 () {54 vars in 930 bytes} [Thu Feb 3 02:49:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:49:59.781324 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-9985d110-c2ad-45c5-83c1-307a4608e619 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 1024, "id": "d2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:49:59.803226 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-9985d110-c2ad-45c5-83c1-307a4608e619 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080840 Feb 03 02:49:59.804107 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 6/11] 10.222.0.31 () {64 vars in 1282 bytes} [Thu Feb 3 02:49:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 03 02:49:59.817399 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-e0b9225a-894a-43d7-828b-5d261d95fd64 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:49:59.845698 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-e0b9225a-894a-43d7-828b-5d261d95fd64 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032287 Feb 03 02:49:59.846543 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 6/12] 10.222.0.31 () {64 vars in 1335 bytes} [Thu Feb 3 02:49:59 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:50:02.094017 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-9985d110-c2ad-45c5-83c1-307a4608e619 admin admin] Calling method '>' {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:02.094598 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-9985d110-c2ad-45c5-83c1-307a4608e619 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001646 Feb 03 02:50:02.095190 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 7/13] 10.222.0.31 () {54 vars in 930 bytes} [Thu Feb 3 02:50:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:50:02.158210 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-48e59c98-256b-40f5-8663-5b3582908700 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "name": "ds2G", "swap": 0}} {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:50:02.177191 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-48e59c98-256b-40f5-8663-5b3582908700 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076200 Feb 03 02:50:02.177736 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 7/14] 10.222.0.31 () {64 vars in 1282 bytes} [Thu Feb 3 02:50:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 03 02:50:02.189369 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-8577217f-3e06-45f1-a391-b98701347349 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:50:02.213650 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-8577217f-3e06-45f1-a391-b98701347349 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027876 Feb 03 02:50:02.214568 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 8/15] 10.222.0.31 () {64 vars in 1335 bytes} [Thu Feb 3 02:50:02 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:50:04.441111 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-48e59c98-256b-40f5-8663-5b3582908700 admin admin] Calling method '>' {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:04.442214 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-48e59c98-256b-40f5-8663-5b3582908700 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001595 Feb 03 02:50:04.442763 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 8/16] 10.222.0.31 () {54 vars in 930 bytes} [Thu Feb 3 02:50:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:50:04.511619 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-0c1f0d49-e667-4a3a-9144-52acd28eb58c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "name": "ds4G", "disk": 20, "os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4"}} {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:50:04.533501 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-0c1f0d49-e667-4a3a-9144-52acd28eb58c admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083219 Feb 03 02:50:04.541488 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 9/17] 10.222.0.31 () {64 vars in 1282 bytes} [Thu Feb 3 02:50:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 03 02:50:04.546895 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-0e84f2b7-495f-449d-b631-cebeb975c590 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:50:04.569127 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-0e84f2b7-495f-449d-b631-cebeb975c590 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026215 Feb 03 02:50:04.569669 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 9/18] 10.222.0.31 () {64 vars in 1335 bytes} [Thu Feb 3 02:50:04 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:50:06.794036 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-0c1f0d49-e667-4a3a-9144-52acd28eb58c admin admin] Calling method '>' {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:06.795074 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-0c1f0d49-e667-4a3a-9144-52acd28eb58c admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Feb 03 02:50:06.795474 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 10/19] 10.222.0.31 () {54 vars in 930 bytes} [Thu Feb 3 02:50:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:50:06.856669 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-54b1f958-d337-4ea4-8e67-3e599f58555e admin admin] Calling method '>' {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:06.885078 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-54b1f958-d337-4ea4-8e67-3e599f58555e admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083239 Feb 03 02:50:06.890578 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 10/20] 10.222.0.31 () {60 vars in 1291 bytes} [Thu Feb 3 02:50:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 02:50:09.203428 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-0c1f0d49-e667-4a3a-9144-52acd28eb58c admin admin] Calling method '>' {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:09.204531 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-0c1f0d49-e667-4a3a-9144-52acd28eb58c admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 Feb 03 02:50:09.204966 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 11/21] 10.222.0.31 () {54 vars in 930 bytes} [Thu Feb 3 02:50:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:50:09.267706 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-10bf9f5a-6ffb-4be1-83aa-f7675272751b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "id": "1", "ram": 512, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny", "rxtx_factor": 1.0}} {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:50:09.286908 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-10bf9f5a-6ffb-4be1-83aa-f7675272751b admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075156 Feb 03 02:50:09.287472 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 11/22] 10.222.0.31 () {64 vars in 1282 bytes} [Thu Feb 3 02:50:09 2022] POST /compute/v2.1/flavors => generated 402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 03 02:50:09.299949 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-099b9ad0-df61-4fbe-b167-1c0fc6c4b720 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:50:09.323481 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-099b9ad0-df61-4fbe-b167-1c0fc6c4b720 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027389 Feb 03 02:50:09.324073 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 12/23] 10.222.0.31 () {64 vars in 1332 bytes} [Thu Feb 3 02:50:09 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:50:11.630305 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-10bf9f5a-6ffb-4be1-83aa-f7675272751b admin admin] Calling method '>' {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:11.631673 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-10bf9f5a-6ffb-4be1-83aa-f7675272751b admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001971 Feb 03 02:50:11.632274 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 12/24] 10.222.0.31 () {54 vars in 930 bytes} [Thu Feb 3 02:50:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:50:11.702658 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-57447a3e-ff80-46a1-8e53-6b858e236978 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "id": "2", "ram": 2048, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.small"}} {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:50:11.723963 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-57447a3e-ff80-46a1-8e53-6b858e236978 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.084361 Feb 03 02:50:11.724552 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 13/25] 10.222.0.31 () {64 vars in 1282 bytes} [Thu Feb 3 02:50:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 03 02:50:11.739855 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-f360adab-1c02-4c0f-aaf8-7b5d1a40985c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:50:11.766614 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-f360adab-1c02-4c0f-aaf8-7b5d1a40985c admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031466 Feb 03 02:50:11.767590 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 13/26] 10.222.0.31 () {64 vars in 1332 bytes} [Thu Feb 3 02:50:11 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:50:14.020502 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-57447a3e-ff80-46a1-8e53-6b858e236978 admin admin] Calling method '>' {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:14.021567 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-57447a3e-ff80-46a1-8e53-6b858e236978 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001607 Feb 03 02:50:14.021983 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 14/27] 10.222.0.31 () {54 vars in 930 bytes} [Thu Feb 3 02:50:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 03 02:50:14.085392 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-97130a12-19c6-4d10-aa30-724c165be8b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "3", "rxtx_factor": 1.0, "ram": 4096, "vcpus": 2, "swap": 0}} {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:50:14.107728 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-97130a12-19c6-4d10-aa30-724c165be8b7 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.079619 Feb 03 02:50:14.108356 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 14/28] 10.222.0.31 () {64 vars in 1282 bytes} [Thu Feb 3 02:50:14 2022] POST /compute/v2.1/flavors => generated 406 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 03 02:50:14.122042 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-b7f7e85b-31f8-41f7-841b-cd493346f0c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:50:14.146957 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-b7f7e85b-31f8-41f7-841b-cd493346f0c7 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028851 Feb 03 02:50:14.147558 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 15/29] 10.222.0.31 () {64 vars in 1332 bytes} [Thu Feb 3 02:50:14 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:50:16.395499 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-97130a12-19c6-4d10-aa30-724c165be8b7 admin admin] Calling method '>' {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:16.396519 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-97130a12-19c6-4d10-aa30-724c165be8b7 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Feb 03 02:50:16.396964 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 15/30] 10.222.0.31 () {54 vars in 930 bytes} [Thu Feb 3 02:50:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:50:16.457414 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-9ddfc4ef-864a-4688-bd2a-cc6c0f670ba3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "4", "ram": 8192, "disk": 80, "name": "m1.large", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:50:16.476002 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-9ddfc4ef-864a-4688-bd2a-cc6c0f670ba3 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073109 Feb 03 02:50:16.476554 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 16/31] 10.222.0.31 () {64 vars in 1282 bytes} [Thu Feb 3 02:50:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 03 02:50:16.488851 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-1e80fc55-5889-400c-82a7-ed49bbd4626c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:50:16.511363 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-1e80fc55-5889-400c-82a7-ed49bbd4626c admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026448 Feb 03 02:50:16.511938 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 16/32] 10.222.0.31 () {64 vars in 1332 bytes} [Thu Feb 3 02:50:16 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:50:18.730353 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-9ddfc4ef-864a-4688-bd2a-cc6c0f670ba3 admin admin] Calling method '>' {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:18.731367 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-9ddfc4ef-864a-4688-bd2a-cc6c0f670ba3 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Feb 03 02:50:18.731874 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 17/33] 10.222.0.31 () {54 vars in 930 bytes} [Thu Feb 3 02:50:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:50:18.786118 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-f9eca0f6-d48b-4615-a936-134f05face02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "rxtx_factor": 1.0, "disk": 160, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "5", "swap": 0, "ram": 16384}} {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:50:18.804754 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-f9eca0f6-d48b-4615-a936-134f05face02 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.067113 Feb 03 02:50:18.805308 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 17/34] 10.222.0.31 () {64 vars in 1282 bytes} [Thu Feb 3 02:50:18 2022] POST /compute/v2.1/flavors => generated 408 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 03 02:50:18.817087 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-aaff851c-7e64-425d-b079-c9d53b0f3a5d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:50:18.840989 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-aaff851c-7e64-425d-b079-c9d53b0f3a5d admin admin] 10.222.0.31 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027578 Feb 03 02:50:18.841604 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 18/35] 10.222.0.31 () {64 vars in 1332 bytes} [Thu Feb 3 02:50:18 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:50:43.655334 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-f9eca0f6-d48b-4615-a936-134f05face02 admin admin] Calling method '>' {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:43.656334 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-f9eca0f6-d48b-4615-a936-134f05face02 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Feb 03 02:50:43.656750 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 18/36] 10.222.0.31 () {54 vars in 930 bytes} [Thu Feb 3 02:50:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:50:43.728330 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-cdeebb69-a284-4647-8238-cd768365f664 admin admin] Calling method '>' {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:43.745550 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-cdeebb69-a284-4647-8238-cd768365f664 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.082685 Feb 03 02:50:43.746062 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 19/37] 10.222.0.31 () {60 vars in 1291 bytes} [Thu Feb 3 02:50:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 03 02:50:45.113770 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-f9eca0f6-d48b-4615-a936-134f05face02 admin admin] Calling method '>' {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:45.114813 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-f9eca0f6-d48b-4615-a936-134f05face02 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Feb 03 02:50:45.115212 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 19/38] 10.222.0.31 () {56 vars in 1074 bytes} [Thu Feb 3 02:50:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:50:45.309730 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-84dde16c-cbba-4d51-96b5-2667f2b40f28 admin admin] Calling method '>' {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:45.315771 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.wsgi [None req-84dde16c-cbba-4d51-96b5-2667f2b40f28 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 03 02:50:45.316271 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-84dde16c-cbba-4d51-96b5-2667f2b40f28 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 02:50:45.317096 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-84dde16c-cbba-4d51-96b5-2667f2b40f28 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063803 Feb 03 02:50:45.317605 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 20/39] 10.222.0.31 () {60 vars in 1190 bytes} [Thu Feb 3 02:50:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 03 02:50:45.329707 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-6acb254b-9e69-4050-8e63-3e6c45662d15 admin admin] Calling method '>' {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:45.356036 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-6acb254b-9e69-4050-8e63-3e6c45662d15 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.032125 Feb 03 02:50:45.356591 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 20/40] 10.222.0.31 () {60 vars in 1210 bytes} [Thu Feb 3 02:50:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 02:50:45.366038 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-e072d3d8-f864-4891-95bb-f12b4b14524c admin admin] Calling method '>' {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:45.387359 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-e072d3d8-f864-4891-95bb-f12b4b14524c admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024817 Feb 03 02:50:45.387887 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 21/41] 10.222.0.31 () {60 vars in 1210 bytes} [Thu Feb 3 02:50:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 02:50:45.397337 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-8eeb7cbf-d1d0-455e-818d-195d06d09388 admin admin] Calling method '>' {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:45.403350 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.wsgi [None req-8eeb7cbf-d1d0-455e-818d-195d06d09388 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 03 02:50:45.403912 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-8eeb7cbf-d1d0-455e-818d-195d06d09388 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 02:50:45.404693 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-8eeb7cbf-d1d0-455e-818d-195d06d09388 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010957 Feb 03 02:50:45.405199 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 21/42] 10.222.0.31 () {60 vars in 1190 bytes} [Thu Feb 3 02:50:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 03 02:50:46.662002 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-e072d3d8-f864-4891-95bb-f12b4b14524c admin admin] Calling method '>' {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:46.663670 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-e072d3d8-f864-4891-95bb-f12b4b14524c admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002488 Feb 03 02:50:46.664351 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 22/43] 10.222.0.31 () {56 vars in 1074 bytes} [Thu Feb 3 02:50:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:50:46.868250 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-90cc8161-8124-4658-bfe3-ee91f8b98b67 admin admin] Calling method '>' {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:46.876782 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.wsgi [None req-90cc8161-8124-4658-bfe3-ee91f8b98b67 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 03 02:50:46.877537 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-90cc8161-8124-4658-bfe3-ee91f8b98b67 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 02:50:46.878333 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-90cc8161-8124-4658-bfe3-ee91f8b98b67 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.069579 Feb 03 02:50:46.878829 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 22/44] 10.222.0.31 () {60 vars in 1190 bytes} [Thu Feb 3 02:50:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 03 02:50:46.888401 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-cbe5df15-e44a-43f0-b786-edfdc357c6a2 admin admin] Calling method '>' {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:46.902030 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-cbe5df15-e44a-43f0-b786-edfdc357c6a2 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017294 Feb 03 02:50:46.902578 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 23/45] 10.222.0.31 () {60 vars in 1210 bytes} [Thu Feb 3 02:50:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 02:50:46.914219 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-023170b7-956d-48a4-b59f-60a13f3b6422 admin admin] Calling method '>' {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:46.928007 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-023170b7-956d-48a4-b59f-60a13f3b6422 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019597 Feb 03 02:50:46.928526 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 23/46] 10.222.0.31 () {60 vars in 1210 bytes} [Thu Feb 3 02:50:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 02:50:46.940102 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-ce1ea87b-3a46-4ee1-829d-5e352c720764 admin admin] Calling method '>' {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:46.946219 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.wsgi [None req-ce1ea87b-3a46-4ee1-829d-5e352c720764 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 03 02:50:46.946774 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-ce1ea87b-3a46-4ee1-829d-5e352c720764 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 02:50:46.947545 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-ce1ea87b-3a46-4ee1-829d-5e352c720764 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012874 Feb 03 02:50:46.948033 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 24/47] 10.222.0.31 () {60 vars in 1190 bytes} [Thu Feb 3 02:50:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 03 02:50:48.217238 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-023170b7-956d-48a4-b59f-60a13f3b6422 admin admin] Calling method '>' {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:48.218360 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-023170b7-956d-48a4-b59f-60a13f3b6422 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Feb 03 02:50:48.218755 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 24/48] 10.222.0.31 () {56 vars in 1074 bytes} [Thu Feb 3 02:50:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:50:48.414215 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-2a6c14e7-177a-451e-b6c6-6d616adf7c5e admin admin] Calling method '>' {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:48.419817 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.wsgi [None req-2a6c14e7-177a-451e-b6c6-6d616adf7c5e admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 03 02:50:48.420709 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-2a6c14e7-177a-451e-b6c6-6d616adf7c5e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101744) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 02:50:48.421525 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-2a6c14e7-177a-451e-b6c6-6d616adf7c5e admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.063506 Feb 03 02:50:48.422028 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 25/49] 10.222.0.31 () {60 vars in 1193 bytes} [Thu Feb 3 02:50:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 03 02:50:48.433955 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-fe53b874-5e5d-474a-a10d-a1f313d456ad admin admin] Calling method '>' {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:48.449377 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-fe53b874-5e5d-474a-a10d-a1f313d456ad admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021167 Feb 03 02:50:48.449871 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 25/50] 10.222.0.31 () {60 vars in 1210 bytes} [Thu Feb 3 02:50:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 02:50:48.459662 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-8e1cff3e-e433-43bf-9478-ba098e728b3e admin admin] Calling method '>' {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:48.472759 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-8e1cff3e-e433-43bf-9478-ba098e728b3e admin admin] 10.222.0.31 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016940 Feb 03 02:50:48.473288 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 26/51] 10.222.0.31 () {60 vars in 1210 bytes} [Thu Feb 3 02:50:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 03 02:50:48.482458 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-568704c0-ebc6-4980-a2ec-ab4e2cd86ba6 admin admin] Calling method '>' {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:48.487794 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.wsgi [None req-568704c0-ebc6-4980-a2ec-ab4e2cd86ba6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 03 02:50:48.488338 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-568704c0-ebc6-4980-a2ec-ab4e2cd86ba6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101745) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 02:50:48.489146 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-568704c0-ebc6-4980-a2ec-ab4e2cd86ba6 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010077 Feb 03 02:50:48.489620 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 26/52] 10.222.0.31 () {60 vars in 1193 bytes} [Thu Feb 3 02:50:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 03 02:50:49.748424 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-8e1cff3e-e433-43bf-9478-ba098e728b3e admin admin] Calling method '>' {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:49.749477 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-8e1cff3e-e433-43bf-9478-ba098e728b3e admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Feb 03 02:50:49.749876 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 27/53] 10.222.0.31 () {56 vars in 1074 bytes} [Thu Feb 3 02:50:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:50:49.950298 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-5ffb1b92-073d-4cad-af8f-7e0caced3ba9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:50:49.971293 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-5ffb1b92-073d-4cad-af8f-7e0caced3ba9 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.083009 Feb 03 02:50:49.971824 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 27/54] 10.222.0.31 () {64 vars in 1235 bytes} [Thu Feb 3 02:50:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 03 02:50:51.235379 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-8e1cff3e-e433-43bf-9478-ba098e728b3e admin admin] Calling method '>' {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:51.236395 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-8e1cff3e-e433-43bf-9478-ba098e728b3e admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Feb 03 02:50:51.236870 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 28/55] 10.222.0.31 () {56 vars in 1074 bytes} [Thu Feb 3 02:50:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:50:51.440639 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-0037cea6-1287-4d07-8f63-e6eaa66c7554 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:50:51.460179 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-0037cea6-1287-4d07-8f63-e6eaa66c7554 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.084453 Feb 03 02:50:51.460758 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 28/56] 10.222.0.31 () {64 vars in 1235 bytes} [Thu Feb 3 02:50:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 03 02:50:52.720201 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-8e1cff3e-e433-43bf-9478-ba098e728b3e admin admin] Calling method '>' {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:52.721237 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-8e1cff3e-e433-43bf-9478-ba098e728b3e admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Feb 03 02:50:52.721625 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 29/57] 10.222.0.31 () {56 vars in 1074 bytes} [Thu Feb 3 02:50:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:50:52.925257 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-3a33829e-336d-4737-9283-8b7e0fe86ae3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:50:52.946758 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-3a33829e-336d-4737-9283-8b7e0fe86ae3 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.086154 Feb 03 02:50:52.947289 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 29/58] 10.222.0.31 () {64 vars in 1235 bytes} [Thu Feb 3 02:50:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 03 02:50:54.209954 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-8e1cff3e-e433-43bf-9478-ba098e728b3e admin admin] Calling method '>' {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:54.210969 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-8e1cff3e-e433-43bf-9478-ba098e728b3e admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Feb 03 02:50:54.211356 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 30/59] 10.222.0.31 () {56 vars in 1074 bytes} [Thu Feb 3 02:50:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:50:54.418731 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-b1828cee-9422-426d-b62b-7bc4b7f50a58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:50:54.448881 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-b1828cee-9422-426d-b62b-7bc4b7f50a58 admin admin] 10.222.0.31 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.101092 Feb 03 02:50:54.449409 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 30/60] 10.222.0.31 () {64 vars in 1235 bytes} [Thu Feb 3 02:50:54 2022] POST /compute/v2.1/flavors => generated 409 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 03 02:50:55.708118 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-8e1cff3e-e433-43bf-9478-ba098e728b3e admin admin] Calling method '>' {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:55.709149 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-8e1cff3e-e433-43bf-9478-ba098e728b3e admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Feb 03 02:50:55.709543 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 31/61] 10.222.0.31 () {56 vars in 1074 bytes} [Thu Feb 3 02:50:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:50:55.911648 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-240cbe92-6d51-463a-bd77-049e0a56073c admin admin] Calling method '>' {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:50:55.931307 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-240cbe92-6d51-463a-bd77-049e0a56073c admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.084932 Feb 03 02:50:55.931772 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 31/62] 10.222.0.31 () {60 vars in 1202 bytes} [Thu Feb 3 02:50:55 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 02:51:41.075961 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-8e1cff3e-e433-43bf-9478-ba098e728b3e admin admin] Calling method '>' {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:51:41.077045 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-8e1cff3e-e433-43bf-9478-ba098e728b3e admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Feb 03 02:51:41.077443 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 32/63] 10.222.0.31 () {54 vars in 930 bytes} [Thu Feb 3 02:51:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:51:41.145932 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-c3f1f99c-fc41-416d-960e-961861704f12 admin admin] Calling method '>' {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:51:41.165671 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-c3f1f99c-fc41-416d-960e-961861704f12 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.081232 Feb 03 02:51:41.166198 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 32/64] 10.222.0.31 () {60 vars in 1291 bytes} [Thu Feb 3 02:51:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 02:51:41.187989 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-1bf565f7-3bcd-47f2-8df8-94cf0d3d8def admin admin] Calling method '>' {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:51:41.195756 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-1bf565f7-3bcd-47f2-8df8-94cf0d3d8def admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011322 Feb 03 02:51:41.196263 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 33/65] 10.222.0.31 () {60 vars in 1282 bytes} [Thu Feb 3 02:51:41 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:51:41.208448 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-431d1482-710f-408e-83d9-b0c78bfb825d admin admin] Calling method '>' {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:51:41.216937 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-431d1482-710f-408e-83d9-b0c78bfb825d admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012808 Feb 03 02:51:41.217464 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 33/66] 10.222.0.31 () {60 vars in 1285 bytes} [Thu Feb 3 02:51:41 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:51:41.228016 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-72972bd8-1ddd-4b0d-a1c9-d2071ae446e1 admin admin] Calling method '>' {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:51:41.236452 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-72972bd8-1ddd-4b0d-a1c9-d2071ae446e1 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011716 Feb 03 02:51:41.237041 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 34/67] 10.222.0.31 () {60 vars in 1285 bytes} [Thu Feb 3 02:51:41 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:51:41.248375 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-be69acca-177b-4db2-9074-1056b96612b9 admin admin] Calling method '>' {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:51:41.256225 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-be69acca-177b-4db2-9074-1056b96612b9 admin admin] 10.222.0.31 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011311 Feb 03 02:51:41.256708 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 34/68] 10.222.0.31 () {60 vars in 1282 bytes} [Thu Feb 3 02:51:41 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:53:06.759107 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-c8faa313-bacd-45a3-81dc-55bf14588ce5 tempest-verify_tempest_config-1772295340 tempest-verify_tempest_config-1772295340-project] Calling method '>' {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:53:06.761130 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-c8faa313-bacd-45a3-81dc-55bf14588ce5 tempest-verify_tempest_config-1772295340 tempest-verify_tempest_config-1772295340-project] 10.222.0.31 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.121521 Feb 03 02:53:06.761663 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 35/69] 10.222.0.31 () {58 vars in 1133 bytes} [Thu Feb 3 02:53:06 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 03 02:54:38.191055 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-be69acca-177b-4db2-9074-1056b96612b9 admin admin] Calling method '>' {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:54:38.192093 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-be69acca-177b-4db2-9074-1056b96612b9 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Feb 03 02:54:38.192488 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 35/70] 10.222.0.31 () {56 vars in 1074 bytes} [Thu Feb 3 02:54:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:54:38.473071 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-3e5de6fb-0759-40f8-b448-cf21e061861a admin admin] Calling method '>' {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:54:38.474225 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:54:38.474225 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: warnings.warn(msg) Feb 03 02:54:38.475742 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG oslo_concurrency.lockutils [None req-3e5de6fb-0759-40f8-b448-cf21e061861a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:54:38.476173 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG oslo_concurrency.lockutils [None req-3e5de6fb-0759-40f8-b448-cf21e061861a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:54:38.476983 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG oslo_concurrency.lockutils [None req-3e5de6fb-0759-40f8-b448-cf21e061861a admin admin] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:54:38.477396 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG oslo_concurrency.lockutils [None req-3e5de6fb-0759-40f8-b448-cf21e061861a admin admin] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:54:38.512282 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-3e5de6fb-0759-40f8-b448-cf21e061861a admin admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.178365 Feb 03 02:54:38.512864 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 36/71] 10.222.0.31 () {60 vars in 1193 bytes} [Thu Feb 3 02:54:38 2022] GET /compute/v2.1/os-services => generated 791 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 03 02:54:39.784211 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-be69acca-177b-4db2-9074-1056b96612b9 admin admin] Calling method '>' {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:54:39.785249 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-be69acca-177b-4db2-9074-1056b96612b9 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Feb 03 02:54:39.785637 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 36/72] 10.222.0.31 () {56 vars in 1074 bytes} [Thu Feb 3 02:54:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:54:39.990511 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-1c11d822-cd87-400c-bc94-f5697701e894 admin admin] Calling method '>' {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:54:39.991612 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:54:39.991612 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: warnings.warn(msg) Feb 03 02:54:39.993178 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG oslo_concurrency.lockutils [None req-1c11d822-cd87-400c-bc94-f5697701e894 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:54:39.993616 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG oslo_concurrency.lockutils [None req-1c11d822-cd87-400c-bc94-f5697701e894 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:54:39.994400 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG oslo_concurrency.lockutils [None req-1c11d822-cd87-400c-bc94-f5697701e894 admin admin] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:54:39.994831 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG oslo_concurrency.lockutils [None req-1c11d822-cd87-400c-bc94-f5697701e894 admin admin] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:54:40.013427 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-1c11d822-cd87-400c-bc94-f5697701e894 admin admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079189 Feb 03 02:54:40.013956 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 37/73] 10.222.0.31 () {60 vars in 1193 bytes} [Thu Feb 3 02:54:39 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 03 02:54:51.727041 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-be69acca-177b-4db2-9074-1056b96612b9 admin admin] Calling method '>' {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:54:51.728077 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-be69acca-177b-4db2-9074-1056b96612b9 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Feb 03 02:54:51.728472 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 37/74] 10.222.0.31 () {56 vars in 1074 bytes} [Thu Feb 3 02:54:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 03 02:54:51.936658 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-bd349033-b595-4d00-88a0-691c16398fe9 admin admin] Calling method '>' {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:54:51.937839 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:54:51.937839 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: warnings.warn(msg) Feb 03 02:54:51.939356 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG oslo_concurrency.lockutils [None req-bd349033-b595-4d00-88a0-691c16398fe9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:54:51.939797 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG oslo_concurrency.lockutils [None req-bd349033-b595-4d00-88a0-691c16398fe9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:54:51.940604 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG oslo_concurrency.lockutils [None req-bd349033-b595-4d00-88a0-691c16398fe9 admin admin] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:54:51.941052 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG oslo_concurrency.lockutils [None req-bd349033-b595-4d00-88a0-691c16398fe9 admin admin] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:54:51.964590 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-bd349033-b595-4d00-88a0-691c16398fe9 admin admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.094159 Feb 03 02:54:51.965154 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 38/75] 10.222.0.31 () {60 vars in 1193 bytes} [Thu Feb 3 02:54:51 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 02:54:53.243888 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: DEBUG nova.api.openstack.wsgi [None req-be69acca-177b-4db2-9074-1056b96612b9 admin admin] Calling method '>' {{(pid=101745) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:54:53.244919 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: INFO nova.api.openstack.requestlog [None req-be69acca-177b-4db2-9074-1056b96612b9 admin admin] 10.222.0.31 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Feb 03 02:54:53.245311 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: [pid: 101745|app: 0|req: 38/76] 10.222.0.31 () {56 vars in 1074 bytes} [Thu Feb 3 02:54:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:54:53.447320 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG nova.api.openstack.wsgi [None req-ebb8352e-4886-4ae3-94e1-438710444908 admin admin] Calling method '>' {{(pid=101744) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:54:53.448474 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:54:53.448474 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: warnings.warn(msg) Feb 03 02:54:53.450060 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG oslo_concurrency.lockutils [None req-ebb8352e-4886-4ae3-94e1-438710444908 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:54:53.450537 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG oslo_concurrency.lockutils [None req-ebb8352e-4886-4ae3-94e1-438710444908 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:54:53.451339 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG oslo_concurrency.lockutils [None req-ebb8352e-4886-4ae3-94e1-438710444908 admin admin] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:54:53.451757 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: DEBUG oslo_concurrency.lockutils [None req-ebb8352e-4886-4ae3-94e1-438710444908 admin admin] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101744) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:54:53.472259 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: INFO nova.api.openstack.requestlog [None req-ebb8352e-4886-4ae3-94e1-438710444908 admin admin] 10.222.0.31 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086338 Feb 03 02:54:53.472819 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: [pid: 101744|app: 0|req: 39/77] 10.222.0.31 () {60 vars in 1193 bytes} [Thu Feb 3 02:54:53 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 02:55:50.086091 dv-cinder-827581-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Feb 03 02:55:50.086663 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: Thu Feb 3 02:55:50 2022 - graceful shutdown triggered... Feb 03 02:55:50.087104 dv-cinder-827581-1-iscsi devstack@n-api.service[101744]: Gracefully killing worker 1 (pid: 101744)... Feb 03 02:55:50.087794 dv-cinder-827581-1-iscsi devstack@n-api.service[101745]: Gracefully killing worker 2 (pid: 101745)... Feb 03 02:55:51.087674 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: worker 1 buried after 1 seconds Feb 03 02:55:51.087674 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: worker 2 buried after 1 seconds Feb 03 02:55:51.087674 dv-cinder-827581-1-iscsi devstack@n-api.service[101743]: goodbye to uWSGI. Feb 03 02:55:51.090045 dv-cinder-827581-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Feb 03 02:55:51.090986 dv-cinder-827581-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Feb 03 02:55:51.095444 dv-cinder-827581-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 03 02:55:51.107847 dv-cinder-827581-1-iscsi devstack@n-api.service[116372]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 03 02:55:51.110538 dv-cinder-827581-1-iscsi devstack@n-api.service[116372]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Feb 3 02:55:51 2022] *** Feb 03 02:55:51.110538 dv-cinder-827581-1-iscsi devstack@n-api.service[116372]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 03 02:55:51.110538 dv-cinder-827581-1-iscsi devstack@n-api.service[116372]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 03 02:55:51.110538 dv-cinder-827581-1-iscsi devstack@n-api.service[116372]: nodename: dv-cinder-827581-1-iscsi Feb 03 02:55:51.110538 dv-cinder-827581-1-iscsi devstack@n-api.service[116372]: machine: x86_64 Feb 03 02:55:51.110538 dv-cinder-827581-1-iscsi devstack@n-api.service[116372]: clock source: unix Feb 03 02:55:51.110538 dv-cinder-827581-1-iscsi devstack@n-api.service[116372]: pcre jit disabled Feb 03 02:55:51.110538 dv-cinder-827581-1-iscsi devstack@n-api.service[116372]: detected number of CPU cores: 4 Feb 03 02:55:51.110538 dv-cinder-827581-1-iscsi devstack@n-api.service[116372]: current working directory: / Feb 03 02:55:51.110538 dv-cinder-827581-1-iscsi devstack@n-api.service[116372]: detected binary path: /usr/bin/uwsgi-core Feb 03 02:55:51.111251 dv-cinder-827581-1-iscsi devstack@n-api.service[116372]: your processes number limit is 47680 Feb 03 02:55:51.111251 dv-cinder-827581-1-iscsi devstack@n-api.service[116372]: your memory page size is 4096 bytes Feb 03 02:55:51.111251 dv-cinder-827581-1-iscsi devstack@n-api.service[116372]: detected max file descriptor number: 2048 Feb 03 02:55:51.111251 dv-cinder-827581-1-iscsi devstack@n-api.service[116372]: lock engine: pthread robust mutexes Feb 03 02:55:51.111251 dv-cinder-827581-1-iscsi devstack@n-api.service[116372]: thunder lock: enabled Feb 03 02:55:51.111251 dv-cinder-827581-1-iscsi devstack@n-api.service[116372]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 03 02:55:51.111251 dv-cinder-827581-1-iscsi devstack@n-api.service[116372]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 03 02:55:51.155918 dv-cinder-827581-1-iscsi devstack@n-api.service[116372]: Python main interpreter initialized at 0x5592721369c0 Feb 03 02:55:51.155918 dv-cinder-827581-1-iscsi devstack@n-api.service[116372]: python threads support enabled Feb 03 02:55:51.155918 dv-cinder-827581-1-iscsi devstack@n-api.service[116372]: your server socket listen backlog is limited to 100 connections Feb 03 02:55:51.155918 dv-cinder-827581-1-iscsi devstack@n-api.service[116372]: your mercy for graceful operations on workers is 90 seconds Feb 03 02:55:51.156376 dv-cinder-827581-1-iscsi devstack@n-api.service[116372]: mapped 403077 bytes (393 KB) for 2 cores Feb 03 02:55:51.156376 dv-cinder-827581-1-iscsi devstack@n-api.service[116372]: *** Operational MODE: preforking *** Feb 03 02:55:51.156640 dv-cinder-827581-1-iscsi devstack@n-api.service[116372]: *** uWSGI is running in multiple interpreter mode *** Feb 03 02:55:51.156640 dv-cinder-827581-1-iscsi devstack@n-api.service[116372]: spawned uWSGI master process (pid: 116372) Feb 03 02:55:51.156881 dv-cinder-827581-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 03 02:55:51.157466 dv-cinder-827581-1-iscsi devstack@n-api.service[116372]: spawned uWSGI worker 1 (pid: 116385, cores: 1) Feb 03 02:55:51.159009 dv-cinder-827581-1-iscsi devstack@n-api.service[116372]: spawned uWSGI worker 2 (pid: 116386, cores: 1) Feb 03 02:55:51.159009 dv-cinder-827581-1-iscsi devstack@n-api.service[116372]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 03 02:55:53.075289 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 03 02:55:53.075289 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: from cryptography.utils import int_from_bytes Feb 03 02:55:53.075935 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 03 02:55:53.075935 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: from cryptography.utils import int_from_bytes Feb 03 02:55:53.079397 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 03 02:55:53.079397 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: from cryptography.utils import int_from_bytes Feb 03 02:55:53.079929 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 03 02:55:53.079929 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: from cryptography.utils import int_from_bytes Feb 03 02:55:55.476608 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 03 02:55:55.477224 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 03 02:55:55.477383 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 03 02:55:55.477750 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 03 02:55:55.477984 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 03 02:55:55.478391 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.478700 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.479043 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.479365 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.480029 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.480373 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.480691 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.481036 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.481366 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.481615 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.481928 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.482250 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-827581-1-iscsi {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.482572 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.482880 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.483189 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.483507 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.483810 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.484133 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.484448 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.484976 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.485417 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.485762 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.486033 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.490544 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.490544 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.490544 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.490544 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.490544 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.490544 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.490544 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.490544 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-827581-1-iscsi {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.491146 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.491146 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.491146 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.491146 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.491146 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.491146 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.491146 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.491146 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.491667 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.491770 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.492542 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.492542 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.492797 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.493062 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.493900 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.493900 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.494063 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.494233 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.498174 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.498174 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.498174 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.498174 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.498174 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.498174 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.498174 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.498705 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.498705 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.498705 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.498705 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.498705 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.498705 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.498705 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.498705 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.499267 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 03 02:55:55.499664 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.499753 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 03 02:55:55.499832 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.499832 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.499973 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 03 02:55:55.500051 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.500152 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 03 02:55:55.500256 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.500339 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 03 02:55:55.500442 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.500514 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.501051 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.501203 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.501300 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.501381 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.501463 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.501540 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.501631 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.501787 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.501932 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.502130 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.502305 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.502485 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.502581 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.502753 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.503338 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.503440 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.503513 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.503593 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.503675 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.503754 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.503950 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.504061 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-827581-1-iscsi {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.504157 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.504339 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.504509 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.504610 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.504830 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.504989 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.505171 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.505311 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.505463 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.505565 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.505738 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.505873 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.506017 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.506209 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.506346 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.506662 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.506798 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.506938 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.507031 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.507287 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.507412 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.507569 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.507676 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.507871 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.507981 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.508178 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.508284 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.508487 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.508595 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.508815 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.508935 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.509126 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.509220 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.509434 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.509536 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.509740 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.509846 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.510030 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.510176 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-827581-1-iscsi {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.510431 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.510645 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.510763 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.510960 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.511050 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.511288 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.511476 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.511618 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.511765 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.511932 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.512080 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.512418 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.512730 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.512871 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.513053 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.513184 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.513396 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.513499 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.513688 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.513789 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.513995 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.514091 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.514314 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.514636 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.514636 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.514920 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.515067 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.515221 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.515356 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.515505 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.515649 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.515800 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.515949 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.516095 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.516242 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.516376 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.516523 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.516659 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.516846 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.516963 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.517058 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.517154 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.517274 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.517374 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.517599 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.517708 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.517852 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.517953 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.518103 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.518231 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.518426 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.518526 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.518776 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.518875 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.519091 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.519185 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.519404 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.519524 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.520033 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.520135 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.520230 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.520322 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.520405 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.520495 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.520600 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.520689 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.520935 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.521056 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.521248 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.521336 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.521556 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.521716 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.521873 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.521972 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.522198 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.522295 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.522524 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.522632 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.522826 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.522931 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.523162 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.523259 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.31 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.523466 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.31 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.523553 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.523778 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.523878 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.524118 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.524213 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.524430 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.524523 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.524759 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.524862 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.525089 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.525186 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.525400 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.525498 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.525710 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.525805 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.526019 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.526116 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.526327 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.526418 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.526647 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.526735 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.526976 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.527071 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.527284 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.527387 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.527537 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.527686 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.527843 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.527933 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.528152 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.528250 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.528476 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.528566 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.528817 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.528920 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.529131 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.529235 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.529442 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.529557 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.529746 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.529843 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.530055 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.530154 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.530366 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.530463 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.530674 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.530764 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.530984 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.531074 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.531292 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.531394 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.531598 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.531694 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.531905 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.532002 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.532212 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.532307 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.532518 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.532623 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.532865 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.532964 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.533176 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.533277 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.533485 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.533581 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.533826 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.533935 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.534099 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.534198 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.534456 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.534561 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.534773 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.534860 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.535085 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.535241 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.535392 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.535487 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.535696 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.535782 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.536010 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.536098 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.536316 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.536436 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.536627 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.536746 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.536974 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.537105 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.537279 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.537366 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.537590 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.537728 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.537898 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.538184 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.538298 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.538505 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.538665 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.538810 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.538963 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.539116 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.539259 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.539416 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.539567 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.539717 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.539868 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.540017 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.540160 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.540311 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.540454 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.540595 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.540954 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.541183 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.541342 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.541601 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.541771 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.541771 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.542054 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.542210 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.542353 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.542494 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.542604 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.542700 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.542785 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.542879 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.542964 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.543043 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.543272 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 03 02:55:55.543386 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.543583 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.543715 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.543980 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.544163 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.544361 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.544636 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.544960 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.545139 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.545290 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.545505 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.545652 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.545976 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.546149 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.546300 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.547623 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.547776 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.547882 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.547972 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.548062 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.548139 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.548220 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.548308 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.548403 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.548489 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.548489 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.548642 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.548750 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.548750 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.548913 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.548997 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.549082 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.549164 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.549243 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.549468 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.549604 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.549775 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.551095 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.551349 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.551455 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.551757 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.552071 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.552424 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.552800 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.553121 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.553402 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.553521 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.553702 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.553817 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.554049 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.554159 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.554363 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.554475 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.554685 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.554877 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.555030 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.555182 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.555340 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.555489 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.555637 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.555792 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.555947 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.556090 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.556262 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.556411 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.556552 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.556691 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.556924 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.557075 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.557222 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.557367 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.557510 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.557653 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.557791 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.557967 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.558120 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.558282 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.558425 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.558639 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.558847 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.558999 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.559152 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.559291 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.559437 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.559611 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.559758 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.559980 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.560177 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.560325 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.560478 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.560617 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.560784 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.560955 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.561055 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.561179 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.561300 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.561528 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.561817 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.561986 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.562174 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.562439 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.562594 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.562789 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.563022 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.563181 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.563508 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.563640 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.563731 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.563940 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.564047 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.564220 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.564335 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.564560 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.564700 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.564899 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.564994 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.565215 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.565340 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.565532 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.565771 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.565893 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.566000 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.566376 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.566574 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.566863 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.566987 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.567199 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.567354 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.567482 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.567629 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.567797 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.567927 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.568109 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.568234 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.568421 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.568546 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.568746 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.569065 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.569378 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.569685 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.569988 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.570304 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.570629 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.570945 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.571269 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.571595 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.571746 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.571917 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.572185 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.572506 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.572889 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.573155 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.573461 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.573767 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.574113 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.574305 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.574529 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.574692 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.574836 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.574979 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.575128 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.575287 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.575430 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.575621 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.575771 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.575934 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.576084 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.576240 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.576390 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.576665 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.576883 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.577038 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.577181 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.577376 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.577531 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.577681 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.577825 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.577967 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.578136 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.578286 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.578429 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.578569 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.578718 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.578868 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.579020 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.579163 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.579303 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.579444 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.579591 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.579740 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.579891 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.580053 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.580195 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.580352 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.580506 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.580647 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.580827 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.580973 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.581114 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.581373 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.581529 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.581688 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.581830 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.581971 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.582137 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.582400 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.582549 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.582706 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.582850 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.583088 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.583244 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.583396 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.583546 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.583717 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.583944 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.584120 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.584359 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.584525 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.584838 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.585006 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.585161 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.585303 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.585455 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.585597 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.585753 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.586048 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.586315 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.586315 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.586604 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.586864 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.587030 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.587174 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.587317 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.587458 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.587599 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.587740 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.587895 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.588048 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.588198 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.588341 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.588491 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.588642 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.588829 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.588977 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.589126 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.589284 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.589437 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.589588 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.589731 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.589873 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.590014 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.590168 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.590320 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.590482 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.590634 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.590795 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.590938 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.591089 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.591240 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.591462 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.591609 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.591759 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.591902 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.592057 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.592200 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.592349 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.592598 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.592787 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.593023 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.593256 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.593412 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.593565 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.593707 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.594069 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.594230 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.594393 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.594621 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.594855 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.595013 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.595165 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.595336 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.595480 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.595622 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.595772 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.595924 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.596066 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.596222 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.596373 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.596524 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.596674 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.596908 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.597171 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.597397 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.597562 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.597707 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.597859 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.598141 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.598318 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.598470 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.598612 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.598761 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.598906 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.598906 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.599184 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.599337 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.599480 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.599644 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.599795 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.599937 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.600092 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.600242 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.600399 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.600553 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.600704 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.600888 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.601033 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.601183 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.601333 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.601475 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.601628 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.601784 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.601928 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.602069 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.602217 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.602367 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.602614 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.602866 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.603017 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.603168 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.603372 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.603519 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.603681 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.603838 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.604233 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.604392 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.604535 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.605179 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.605339 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.605483 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.605627 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.605771 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.605921 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.606149 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.606384 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.606602 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.606758 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.606902 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.607266 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.607423 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.607583 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.607738 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.607881 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.608024 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.608024 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.608312 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.608517 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.608662 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.608841 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.609066 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.609066 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.609360 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.609511 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.609654 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.609804 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.609992 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.610146 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.610298 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.610451 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.610602 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.610752 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.610911 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.611070 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.611222 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.611365 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.611515 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.611667 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.611819 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.611961 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.612113 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.612263 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.612405 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.612405 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.612790 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.613067 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.613840 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.613840 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.614158 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.614436 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.614589 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.614742 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.614886 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.615125 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.615390 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.615539 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.615691 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.615856 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.616007 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.616158 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.616316 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.616458 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.616607 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.616785 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.616934 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.617075 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.617224 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.617476 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.617636 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.617788 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.617942 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.617942 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.618218 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.618360 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.618360 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.618642 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.618793 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.618942 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.619091 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.619233 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.619389 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.619531 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.619673 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.619827 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.619970 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.620110 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.620340 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.620503 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.620646 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.620838 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.620992 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.621143 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.621295 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.621437 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.621586 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.621727 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.621881 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.622036 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.622189 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.622339 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.622481 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.622623 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.622771 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.622933 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.623094 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.623327 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.623482 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.623624 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.623785 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.623937 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.624089 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.624232 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.624511 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.624673 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.624925 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.625082 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.625234 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.625517 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.625676 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.625821 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.625970 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.626132 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.626276 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.626417 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.626573 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.626723 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.626864 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.627013 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.627164 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.627314 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.627484 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.627725 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.627725 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.628008 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.628231 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.628404 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.628548 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.628698 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.628698 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.629042 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.629201 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.629364 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.629515 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.629662 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.630330 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.630510 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.630685 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.630850 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.631000 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.631158 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.631158 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.631453 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.631611 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.631773 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.631932 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.632090 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.632239 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.632388 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.632545 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.632706 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.632893 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.633052 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.633210 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.633384 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.634310 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.634504 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.634779 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.634936 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.634936 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.635220 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.635384 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.635676 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.635854 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.636006 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.636163 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.636321 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.636321 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.636617 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.637122 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.637291 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.637451 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.637618 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.637768 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.637926 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.638084 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.638245 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.638499 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.638672 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.638832 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.638989 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.639137 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.639286 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.639435 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.639594 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.639744 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.639893 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.640048 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.640208 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.640369 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.640541 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.640691 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.640863 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.641028 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.641178 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.641338 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.641488 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.641635 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.641785 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.641941 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.642097 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.642268 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.642418 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.642567 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.642725 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.642885 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.643035 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.643193 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.643344 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.643491 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.643647 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.643835 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.643995 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.644154 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.644431 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.644704 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.645012 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.645164 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.645330 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.645481 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.645765 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.645938 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.646090 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.646238 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.646401 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.646559 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.646710 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.646870 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.647020 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.647177 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.647336 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.647485 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.647642 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.647801 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.647952 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.648115 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.648266 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.648414 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.648563 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.648757 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.649018 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.649193 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.649346 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.649494 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.649651 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.649800 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.649949 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.650111 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.650263 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.650426 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.650580 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.650728 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.650896 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.651061 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.651221 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.651380 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.651528 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.651684 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.651834 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.651992 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.652142 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.652291 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.652440 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.652589 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.652775 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.652950 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.653100 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.653256 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.653405 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.653562 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.653721 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.653879 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.654036 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.654184 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.654332 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.654605 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.654772 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.655063 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.655239 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.655398 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.655548 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.655838 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.656078 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.656240 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.656398 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.656548 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.656697 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.656886 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.657039 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.657187 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.657351 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.657514 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.657665 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.657822 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.657982 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.658139 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.658289 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.658444 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.658595 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.658758 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.658907 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.659156 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.659320 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.659555 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.659709 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.659867 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.660024 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.660172 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.660319 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.660476 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.660635 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.660827 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.660980 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.661129 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.661277 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.661432 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.661601 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.661760 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.661909 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.662067 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.662311 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.662478 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.662641 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.662641 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.662926 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.662926 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.663224 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.663224 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.663516 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.663516 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.663821 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.663971 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.664129 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.664287 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.664437 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.664618 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.664877 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.664877 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.665325 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.665478 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.665628 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.665789 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.666094 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.666255 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.666405 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.666562 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.666711 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.666860 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.667009 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.667172 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.667330 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.667487 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.667636 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.667793 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.667962 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.668126 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.668277 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.668435 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.668586 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.668800 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.668956 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.669123 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.669395 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.669395 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.669704 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.669854 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.670013 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.670192 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.670351 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.670510 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.670660 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.670816 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.670978 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.671130 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.671285 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.671434 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.671582 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.671730 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.671887 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.672045 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.672206 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.672367 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.672554 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.672554 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.672880 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.673038 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.673188 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.673336 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.673485 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.673643 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.673802 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.673966 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.674181 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.674333 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.674489 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.674647 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.674797 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.675227 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.675392 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.675542 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.675692 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.675856 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.676149 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.676304 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.676465 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.676614 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.676862 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.677021 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.677170 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.677327 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.677485 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.677634 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.677795 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.677945 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.678093 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.678241 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.678408 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.678565 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.678795 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.678948 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.679099 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.679247 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.679415 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.679676 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.679848 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.680008 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.680165 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.680315 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.680482 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.680661 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.680836 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.681003 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.681161 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.681312 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.681460 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.681623 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.681773 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.681922 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.682079 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.682228 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.682392 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.682554 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.682713 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.682872 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.683029 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.683186 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.683354 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.683354 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.683653 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.683802 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.683950 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.684098 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.684257 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.684406 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.684565 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.684740 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.684907 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.685087 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.685473 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.685640 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.685791 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.685950 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.688877 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.689080 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.689260 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.689418 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.689571 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.689856 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.690016 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.690182 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.690343 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.690502 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.690715 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.690881 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.691042 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.691042 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.691349 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.691349 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.691647 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.691807 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.691975 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.692139 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.692303 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.692454 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.692604 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.692806 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.692975 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.693127 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.693277 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.693433 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.693592 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.693742 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.693916 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.694067 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.694226 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.694375 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.694524 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.694672 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.694829 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.694978 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.695127 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.695284 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.695675 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.695836 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.696002 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.696165 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.696316 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.696474 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.696632 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.696832 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.696995 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.697172 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.697338 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.697498 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.697660 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.697819 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.698116 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.698294 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.698472 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.698777 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.698937 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.699098 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.699258 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.699423 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.699575 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.699733 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.699908 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.700151 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.700306 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.700464 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.700631 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.700853 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.701026 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.701187 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.701338 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.701494 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.701645 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.701793 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.701952 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.702110 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.702269 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.702419 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.702570 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.702731 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.702895 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.703046 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.703196 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.703196 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.703490 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.703659 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.703810 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.703974 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.704148 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.704408 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.704587 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.704782 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.704963 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.705115 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.705273 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.705579 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.705844 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.706016 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.706167 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.706356 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.706515 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.706674 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.706834 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.706993 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.707144 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.707144 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.707450 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.707598 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.707792 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.707953 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.708103 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.708258 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.708407 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.708564 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.708901 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.708901 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.709250 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.709405 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.709584 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.709736 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.709899 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.710058 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.710318 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.710483 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.710640 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.710800 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.710966 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.711125 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.711283 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.711441 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.711609 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.711769 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.711928 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.712079 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.712229 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.712229 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.712513 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.712683 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.712861 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.713025 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.713192 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.713343 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.713514 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.713680 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.713840 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.713991 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.714148 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.714299 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.714465 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.714617 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.714775 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.714775 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.715068 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.715230 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.715474 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.715786 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.716043 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.716200 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.716351 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.716512 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.716663 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.716857 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.717008 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.717157 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.717306 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.717468 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.717627 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.717798 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.717951 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.718112 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.718263 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.718427 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.718583 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.718583 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.718897 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.719185 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.719351 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.719503 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.719653 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.719815 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.719965 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.720124 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.720306 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.720552 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.720709 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.720883 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.721033 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.721199 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.721363 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.721522 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.721681 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.721681 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.722039 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.722202 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.722360 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.722511 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.722660 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.722817 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.722967 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.722967 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.723334 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.723485 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.723646 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.723797 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.723956 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.724115 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.724265 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.724422 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.724579 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.724766 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.724923 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.725085 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.725236 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.725385 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.725542 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.725840 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.726147 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.726309 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.726460 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.726618 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.726768 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.726925 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.727085 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.727269 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.727428 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.727577 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.727726 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.727726 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.728020 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.728221 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.728377 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.728526 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.728674 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.728848 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.728956 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.729206 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.729344 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.729437 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.729529 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.729983 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.730070 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.730156 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.730242 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.730315 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.730391 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.730473 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.730570 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.730646 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.730725 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.730804 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.730876 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.730961 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.731034 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.731105 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.731176 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.731254 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.731336 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.731415 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.731487 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.731559 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.731639 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.731712 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.731792 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.731792 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.731923 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.732001 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.732074 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.732152 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.732238 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.732320 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.732392 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.732462 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.732541 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.732621 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.732873 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.732972 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.733047 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.733118 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.733196 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.733277 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.733357 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.733437 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.733510 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.733588 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.733666 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.733752 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.733832 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.733915 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.733915 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.734052 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.734122 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.734203 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.734283 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.734362 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.734435 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.734505 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.734575 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.734658 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.734658 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 03 02:55:55.734794 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.734794 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.734794 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.734794 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.734794 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.734794 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.734794 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.734794 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.735308 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.735308 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.735308 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.735308 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.735308 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.735308 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.735308 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.735308 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.735962 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.735962 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.735962 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.735962 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.735962 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.735962 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.735962 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.735962 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.736506 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.736506 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.736506 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.736506 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.736506 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.736506 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.736506 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.736506 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.737182 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.737182 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.737182 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.737182 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.737182 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.737182 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.737182 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.737182 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.737727 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.737727 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.737727 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.737727 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.737727 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.737727 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.738159 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.738231 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.738536 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.738860 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.739263 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.739492 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.739814 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.740126 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.740457 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.741170 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.741170 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.741496 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.741757 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.742061 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.742367 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.742677 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.743534 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.743534 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.743725 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.743959 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.744272 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.744590 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.744937 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.745257 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.745578 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.745898 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.746312 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.746528 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.746867 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.747144 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.747524 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.747763 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.748135 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.748364 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.748674 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.749029 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.749276 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_db.sqlalchemy.engines [None req-7770cb24-7ebd-4e4a-a2f2-944fa59567be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 03 02:55:55.749753 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.749753 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.750122 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.750286 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.750557 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.751051 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.751268 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.751492 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.751809 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.752122 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.752478 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.753466 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.753466 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.753466 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.753998 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.754150 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.754446 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.754802 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.755121 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.755468 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.755799 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.756237 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.756424 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.756752 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 03 02:55:55.757027 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 03 02:55:55.785408 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_db.sqlalchemy.engines [None req-26db8d60-b73c-4826-af96-b940fc616a3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 03 02:55:55.812851 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.context [None req-7770cb24-7ebd-4e4a-a2f2-944fa59567be None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),40cf0a47-7e1e-4d6b-9709-06f3170571bd(cell1) {{(pid=116385) load_cells /opt/stack/nova/nova/context.py:464}} Feb 03 02:55:55.817190 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7770cb24-7ebd-4e4a-a2f2-944fa59567be None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:55:55.818811 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7770cb24-7ebd-4e4a-a2f2-944fa59567be None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:55:55.819632 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7770cb24-7ebd-4e4a-a2f2-944fa59567be None None] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:55:55.821613 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7770cb24-7ebd-4e4a-a2f2-944fa59567be None None] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:55:55.832007 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_db.sqlalchemy.engines [None req-7770cb24-7ebd-4e4a-a2f2-944fa59567be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 03 02:55:55.835316 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_db.sqlalchemy.engines [None req-7770cb24-7ebd-4e4a-a2f2-944fa59567be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 03 02:55:55.851248 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.context [None req-26db8d60-b73c-4826-af96-b940fc616a3e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),40cf0a47-7e1e-4d6b-9709-06f3170571bd(cell1) {{(pid=116386) load_cells /opt/stack/nova/nova/context.py:464}} Feb 03 02:55:55.855944 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-26db8d60-b73c-4826-af96-b940fc616a3e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:55:55.857565 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-26db8d60-b73c-4826-af96-b940fc616a3e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:55:55.858479 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-26db8d60-b73c-4826-af96-b940fc616a3e None None] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:55:55.860457 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-26db8d60-b73c-4826-af96-b940fc616a3e None None] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:55:55.874161 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_db.sqlalchemy.engines [None req-26db8d60-b73c-4826-af96-b940fc616a3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 03 02:55:55.875131 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_db.sqlalchemy.engines [None req-26db8d60-b73c-4826-af96-b940fc616a3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 03 02:55:55.991990 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_db.sqlalchemy.engines [None req-7770cb24-7ebd-4e4a-a2f2-944fa59567be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 03 02:55:56.032040 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_db.sqlalchemy.engines [None req-26db8d60-b73c-4826-af96-b940fc616a3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 03 02:55:56.304859 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: WARNING keystonemiddleware.auth_token [None req-7770cb24-7ebd-4e4a-a2f2-944fa59567be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 03 02:55:56.311441 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: WARNING keystonemiddleware.auth_token [None req-7770cb24-7ebd-4e4a-a2f2-944fa59567be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 03 02:55:56.344291 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: WARNING keystonemiddleware.auth_token [None req-26db8d60-b73c-4826-af96-b940fc616a3e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 03 02:55:56.351589 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: WARNING keystonemiddleware.auth_token [None req-26db8d60-b73c-4826-af96-b940fc616a3e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 03 02:55:56.650831 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: WARNING keystonemiddleware.auth_token [None req-7770cb24-7ebd-4e4a-a2f2-944fa59567be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 03 02:55:56.656071 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: WARNING keystonemiddleware.auth_token [None req-7770cb24-7ebd-4e4a-a2f2-944fa59567be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 03 02:55:56.661523 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5592721369c0 pid: 116385 (default app) Feb 03 02:55:56.692420 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: WARNING keystonemiddleware.auth_token [None req-26db8d60-b73c-4826-af96-b940fc616a3e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 03 02:55:56.697664 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: WARNING keystonemiddleware.auth_token [None req-26db8d60-b73c-4826-af96-b940fc616a3e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 03 02:55:56.703085 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5592721369c0 pid: 116386 (default app) Feb 03 02:56:31.324330 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-c2d3e3c7-8862-4b13-a688-6157e251561b tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] Action: 'create', calling method: .version_select at 0x7ff99eee2dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1081023382"}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:56:31.821034 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-a7edefe0-ade3-4a6b-b8ea-bee67f889117 tempest-VolumesGetTestJSON-180290230 tempest-VolumesGetTestJSON-180290230-project] Action: 'create', calling method: .version_select at 0x7ff99eee1dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-877079515", "metadata": {"Type": "work"}}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:56:33.143604 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-c2d3e3c7-8862-4b13-a688-6157e251561b tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.194322 Feb 03 02:56:33.144907 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 1/1] 10.222.0.31 () {60 vars in 1154 bytes} [Thu Feb 3 02:56:29 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3197 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 03 02:56:33.313314 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-bdcadf6d-75fe-4420-9bd6-9b0334094082 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-102339879", "imageRef": "99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce", "flavorRef": "452", "networks": [{"uuid": "9723d542-6d8e-49e5-9dba-f02cc45de9c9"}]}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:56:33.509305 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.network.neutron [None req-bdcadf6d-75fe-4420-9bd6-9b0334094082 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] validate_networks() for [('9723d542-6d8e-49e5-9dba-f02cc45de9c9', None, None, None, None, None)] {{(pid=116385) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 03 02:56:33.902375 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-a7edefe0-ade3-4a6b-b8ea-bee67f889117 tempest-VolumesGetTestJSON-180290230 tempest-VolumesGetTestJSON-180290230-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.422812 Feb 03 02:56:33.903129 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 1/2] 10.222.0.31 () {60 vars in 1155 bytes} [Thu Feb 3 02:56:30 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3425 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 03 02:56:34.012372 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-1d744956-d2fc-4676-8bd3-47db729a035c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1039167817", "imageRef": "99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce", "flavorRef": "452", "networks": [{"uuid": "126c5997-2080-4b93-9c71-959073b0550c"}]}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:56:34.221939 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.network.neutron [None req-1d744956-d2fc-4676-8bd3-47db729a035c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] validate_networks() for [('126c5997-2080-4b93-9c71-959073b0550c', None, None, None, None, None)] {{(pid=116386) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 03 02:56:35.438041 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-bdcadf6d-75fe-4420-9bd6-9b0334094082 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Flavor limits 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 03 02:56:35.438641 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-bdcadf6d-75fe-4420-9bd6-9b0334094082 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Image limits 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 03 02:56:35.438968 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-bdcadf6d-75fe-4420-9bd6-9b0334094082 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Flavor pref 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 03 02:56:35.439500 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-bdcadf6d-75fe-4420-9bd6-9b0334094082 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Image pref 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 03 02:56:35.439909 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-bdcadf6d-75fe-4420-9bd6-9b0334094082 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 03 02:56:35.487135 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bdcadf6d-75fe-4420-9bd6-9b0334094082 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:35.487577 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bdcadf6d-75fe-4420-9bd6-9b0334094082 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:35.494347 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bdcadf6d-75fe-4420-9bd6-9b0334094082 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:35.494792 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bdcadf6d-75fe-4420-9bd6-9b0334094082 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:35.499615 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-1d744956-d2fc-4676-8bd3-47db729a035c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Flavor limits 0:0:0 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 03 02:56:35.500145 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-1d744956-d2fc-4676-8bd3-47db729a035c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Image limits 0:0:0 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 03 02:56:35.500883 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-1d744956-d2fc-4676-8bd3-47db729a035c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Flavor pref 0:0:0 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 03 02:56:35.501306 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-1d744956-d2fc-4676-8bd3-47db729a035c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Image pref 0:0:0 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 03 02:56:35.502652 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-1d744956-d2fc-4676-8bd3-47db729a035c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 03 02:56:35.537833 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1d744956-d2fc-4676-8bd3-47db729a035c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:35.538662 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1d744956-d2fc-4676-8bd3-47db729a035c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:35.542653 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1d744956-d2fc-4676-8bd3-47db729a035c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:35.545316 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1d744956-d2fc-4676-8bd3-47db729a035c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:35.574771 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-bdcadf6d-75fe-4420-9bd6-9b0334094082 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Getting quotas for project a2f534df59e149f8b14cd7406f932b2d. Resources: {'cores', 'ram', 'instances'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 02:56:35.594327 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-bdcadf6d-75fe-4420-9bd6-9b0334094082 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Getting quotas for user 3b69c633ad9a496f924f8f2479eea06d and project a2f534df59e149f8b14cd7406f932b2d. Resources: {'cores', 'ram', 'instances'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 02:56:35.619209 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-bdcadf6d-75fe-4420-9bd6-9b0334094082 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Going to run 1 instances... {{(pid=116385) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 03 02:56:35.624653 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-bdcadf6d-75fe-4420-9bd6-9b0334094082 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 03 02:56:35.684437 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.quota [None req-1d744956-d2fc-4676-8bd3-47db729a035c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Getting quotas for project ff777728bb704feeabf264e753679daa. Resources: {'cores', 'ram', 'instances'} {{(pid=116386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 02:56:35.700541 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.quota [None req-1d744956-d2fc-4676-8bd3-47db729a035c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Getting quotas for user 087b5f4f3891413b8b7fa727768c09a4 and project ff777728bb704feeabf264e753679daa. Resources: {'cores', 'ram', 'instances'} {{(pid=116386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 02:56:35.754092 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-1d744956-d2fc-4676-8bd3-47db729a035c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Going to run 1 instances... {{(pid=116386) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 03 02:56:35.771254 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-1d744956-d2fc-4676-8bd3-47db729a035c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 03 02:56:35.790122 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-bdcadf6d-75fe-4420-9bd6-9b0334094082 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.643728 Feb 03 02:56:35.801147 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 2/3] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Feb 3 02:56:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 03 02:56:35.806506 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-c95cc139-6cc7-411d-8e3f-7fdc2c34d12b tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] Calling method '.version_select at 0x7ff99e4520d0>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:35.978453 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-c95cc139-6cc7-411d-8e3f-7fdc2c34d12b tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/c3e1b906-b672-4fb9-b4c4-0ee437fcff0b" status: 200 len: 346 microversion: 2.1 time: 0.175716 Feb 03 02:56:35.986477 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 3/4] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Feb 3 02:56:35 2022] GET /compute/v2.1/os-volumes/c3e1b906-b672-4fb9-b4c4-0ee437fcff0b => generated 346 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:56:35.991109 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-2659691a-4e2f-4731-b0ac-bacd61975aed tempest-VolumesGetTestJSON-180290230 tempest-VolumesGetTestJSON-180290230-project] Calling method '.version_select at 0x7ff99e452ca0>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:36.030925 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-1d744956-d2fc-4676-8bd3-47db729a035c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.126260 Feb 03 02:56:36.031596 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 2/5] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Feb 3 02:56:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 03 02:56:36.041875 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-490c9714-7eb5-49a8-b5f0-181c3a77a865 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:36.059213 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-490c9714-7eb5-49a8-b5f0-181c3a77a865 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:36.095902 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-2659691a-4e2f-4731-b0ac-bacd61975aed tempest-VolumesGetTestJSON-180290230 tempest-VolumesGetTestJSON-180290230-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/71c8d62a-25fa-48d2-b313-c3d71f734763" status: 200 len: 353 microversion: 2.1 time: 0.108199 Feb 03 02:56:36.096495 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 4/6] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Feb 3 02:56:35 2022] GET /compute/v2.1/os-volumes/71c8d62a-25fa-48d2-b313-c3d71f734763 => generated 353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:56:36.101013 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-5d10a899-0fe8-4f93-a943-ef015e7a7032 tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] Action: 'create', calling method: .version_select at 0x7ff99e442f70>, body: {"snapshot": {"volume_id": "c3e1b906-b672-4fb9-b4c4-0ee437fcff0b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-918437443"}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:56:36.693314 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-490c9714-7eb5-49a8-b5f0-181c3a77a865 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:36.731170 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-490c9714-7eb5-49a8-b5f0-181c3a77a865 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1214 microversion: 2.1 time: 0.693201 Feb 03 02:56:36.732257 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 3/7] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:36 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1214 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:36.737365 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-344cb48f-bf9d-4e57-9634-3f7c029ecd6c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:36.738489 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-344cb48f-bf9d-4e57-9634-3f7c029ecd6c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:36.958710 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-344cb48f-bf9d-4e57-9634-3f7c029ecd6c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:36.968017 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-5d10a899-0fe8-4f93-a943-ef015e7a7032 tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] 10.222.0.31 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.870280 Feb 03 02:56:36.968673 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 5/8] 10.222.0.31 () {60 vars in 1161 bytes} [Thu Feb 3 02:56:36 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:56:36.978271 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-689a6a8c-6040-4e3e-962a-1323587233d8 tempest-VolumesGetTestJSON-180290230 tempest-VolumesGetTestJSON-180290230-project] Calling method '.version_select at 0x7ff99e452430>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:36.988313 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-344cb48f-bf9d-4e57-9634-3f7c029ecd6c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1218 microversion: 2.1 time: 0.254739 Feb 03 02:56:37.006861 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 4/9] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:36 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1218 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:37.023842 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-5575c3f4-c583-44f6-a3ab-ef46acb613da tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] Calling method '.version_select at 0x7ff99dc050d0>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:37.092762 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-689a6a8c-6040-4e3e-962a-1323587233d8 tempest-VolumesGetTestJSON-180290230 tempest-VolumesGetTestJSON-180290230-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/71c8d62a-25fa-48d2-b313-c3d71f734763" status: 200 len: 353 microversion: 2.1 time: 0.118136 Feb 03 02:56:37.093367 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 6/10] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Feb 3 02:56:36 2022] GET /compute/v2.1/os-volumes/71c8d62a-25fa-48d2-b313-c3d71f734763 => generated 353 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:56:37.111402 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-66037a87-d151-4222-9448-236114ed4c4a tempest-VolumesGetTestJSON-180290230 tempest-VolumesGetTestJSON-180290230-project] Calling method '.version_select at 0x7ff99dbe4670>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:37.149560 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-5575c3f4-c583-44f6-a3ab-ef46acb613da tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/b4fe8022-fe26-41ed-a08f-07802f7584de" status: 200 len: 286 microversion: 2.1 time: 0.139654 Feb 03 02:56:37.154796 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 5/11] 10.222.0.31 () {58 vars in 1250 bytes} [Thu Feb 3 02:56:37 2022] GET /compute/v2.1/os-snapshots/b4fe8022-fe26-41ed-a08f-07802f7584de => generated 286 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:56:37.160529 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-58bd1f26-59a4-4972-adbc-a86fc6e105be tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] Calling method '.version_select at 0x7ff99dc05b80>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:37.310108 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-66037a87-d151-4222-9448-236114ed4c4a tempest-VolumesGetTestJSON-180290230 tempest-VolumesGetTestJSON-180290230-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/71c8d62a-25fa-48d2-b313-c3d71f734763" status: 202 len: 0 microversion: 2.1 time: 0.202597 Feb 03 02:56:37.316242 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 7/12] 10.222.0.31 () {58 vars in 1247 bytes} [Thu Feb 3 02:56:37 2022] DELETE /compute/v2.1/os-volumes/71c8d62a-25fa-48d2-b313-c3d71f734763 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 03 02:56:37.325049 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-9ff22e9f-e5a6-426f-a2cd-da08b185a979 tempest-VolumesGetTestJSON-180290230 tempest-VolumesGetTestJSON-180290230-project] Calling method '.version_select at 0x7ff99e452670>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:37.421076 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-58bd1f26-59a4-4972-adbc-a86fc6e105be tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.264458 Feb 03 02:56:37.422075 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 6/13] 10.222.0.31 () {58 vars in 1139 bytes} [Thu Feb 3 02:56:37 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 03 02:56:37.433046 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-64e8cb6d-f22c-41f7-b7ff-4e314cf72c75 tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] Calling method '.version_select at 0x7ff99dc05dc0>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:37.508629 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-9ff22e9f-e5a6-426f-a2cd-da08b185a979 tempest-VolumesGetTestJSON-180290230 tempest-VolumesGetTestJSON-180290230-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/71c8d62a-25fa-48d2-b313-c3d71f734763" status: 200 len: 352 microversion: 2.1 time: 0.191179 Feb 03 02:56:37.514943 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 8/14] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Feb 3 02:56:37 2022] GET /compute/v2.1/os-volumes/71c8d62a-25fa-48d2-b313-c3d71f734763 => generated 352 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:56:37.568324 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-64e8cb6d-f22c-41f7-b7ff-4e314cf72c75 tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/b4fe8022-fe26-41ed-a08f-07802f7584de" status: 200 len: 286 microversion: 2.1 time: 0.138449 Feb 03 02:56:37.571734 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 7/15] 10.222.0.31 () {58 vars in 1250 bytes} [Thu Feb 3 02:56:37 2022] GET /compute/v2.1/os-snapshots/b4fe8022-fe26-41ed-a08f-07802f7584de => generated 286 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:56:37.749043 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-b6c14fa5-e163-4a09-9c3d-a4aa16fafb4b tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:37.749812 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-b6c14fa5-e163-4a09-9c3d-a4aa16fafb4b tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:37.971588 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-b6c14fa5-e163-4a09-9c3d-a4aa16fafb4b tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:38.000318 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-b6c14fa5-e163-4a09-9c3d-a4aa16fafb4b tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1214 microversion: 2.1 time: 0.251671 Feb 03 02:56:38.007460 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 9/16] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:37 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1214 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:38.023029 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-4567be66-2d43-40a8-a419-a11f0b8c258f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:38.024680 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-4567be66-2d43-40a8-a419-a11f0b8c258f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:38.031796 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4567be66-2d43-40a8-a419-a11f0b8c258f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:38.032605 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4567be66-2d43-40a8-a419-a11f0b8c258f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:38.033728 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4567be66-2d43-40a8-a419-a11f0b8c258f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:38.034390 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4567be66-2d43-40a8-a419-a11f0b8c258f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:38.279898 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-4567be66-2d43-40a8-a419-a11f0b8c258f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:38.300041 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-4567be66-2d43-40a8-a419-a11f0b8c258f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1222 microversion: 2.1 time: 0.280589 Feb 03 02:56:38.303385 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 8/17] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:38 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1222 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:38.522428 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-ce471bbd-a8ee-4ce7-9b5e-3bec75f96357 tempest-VolumesGetTestJSON-180290230 tempest-VolumesGetTestJSON-180290230-project] Calling method '.version_select at 0x7ff99db80790>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:38.581019 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-809d8e8b-4429-46f6-9524-622e07ea9e2e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-658647520", "imageRef": "99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:56:38.641519 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-ce471bbd-a8ee-4ce7-9b5e-3bec75f96357 tempest-VolumesGetTestJSON-180290230 tempest-VolumesGetTestJSON-180290230-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/71c8d62a-25fa-48d2-b313-c3d71f734763" status: 200 len: 352 microversion: 2.1 time: 0.123995 Feb 03 02:56:38.642883 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 9/18] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Feb 3 02:56:38 2022] GET /compute/v2.1/os-volumes/71c8d62a-25fa-48d2-b313-c3d71f734763 => generated 352 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:56:38.651319 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-c02954d7-e031-4a80-9b0a-959552e41e21 tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] Calling method '.version_select at 0x7ff99dba31f0>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:38.657304 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.network.neutron [None req-809d8e8b-4429-46f6-9524-622e07ea9e2e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] validate_networks() for [('f43a5cf5-27e4-4762-a93b-2169348c9878', None, None, None, None, None)] {{(pid=116385) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 03 02:56:38.714557 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-c02954d7-e031-4a80-9b0a-959552e41e21 tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/b4fe8022-fe26-41ed-a08f-07802f7584de" status: 200 len: 286 microversion: 2.1 time: 0.070237 Feb 03 02:56:38.725520 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 10/19] 10.222.0.31 () {58 vars in 1250 bytes} [Thu Feb 3 02:56:38 2022] GET /compute/v2.1/os-snapshots/b4fe8022-fe26-41ed-a08f-07802f7584de => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:56:39.025061 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-77f8c7df-d4c5-48a4-9167-6e69e3793dd9 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:39.027404 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-77f8c7df-d4c5-48a4-9167-6e69e3793dd9 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:39.035067 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-77f8c7df-d4c5-48a4-9167-6e69e3793dd9 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:39.035873 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-77f8c7df-d4c5-48a4-9167-6e69e3793dd9 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:39.036880 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-77f8c7df-d4c5-48a4-9167-6e69e3793dd9 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:39.037476 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-77f8c7df-d4c5-48a4-9167-6e69e3793dd9 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:39.144841 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-77f8c7df-d4c5-48a4-9167-6e69e3793dd9 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:39.165674 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-77f8c7df-d4c5-48a4-9167-6e69e3793dd9 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1218 microversion: 2.1 time: 0.144471 Feb 03 02:56:39.177967 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 11/20] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:39 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1218 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:56:39.320373 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-998fbc91-4d36-4df5-aaa5-e31d7ba23f93 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:39.322290 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-998fbc91-4d36-4df5-aaa5-e31d7ba23f93 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:39.329318 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-998fbc91-4d36-4df5-aaa5-e31d7ba23f93 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:39.329809 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-998fbc91-4d36-4df5-aaa5-e31d7ba23f93 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:39.330602 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-998fbc91-4d36-4df5-aaa5-e31d7ba23f93 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:39.334209 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-998fbc91-4d36-4df5-aaa5-e31d7ba23f93 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:39.518483 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-998fbc91-4d36-4df5-aaa5-e31d7ba23f93 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:39.532794 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-998fbc91-4d36-4df5-aaa5-e31d7ba23f93 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1222 microversion: 2.1 time: 0.215193 Feb 03 02:56:39.535131 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 12/21] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:39 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1222 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:56:39.659028 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-cac08c77-bd4a-4ccb-ae64-d53822316c07 tempest-VolumesGetTestJSON-180290230 tempest-VolumesGetTestJSON-180290230-project] Calling method '.version_select at 0x7ff99db46e50>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:39.746093 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-809d8e8b-4429-46f6-9524-622e07ea9e2e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Flavor limits 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 03 02:56:39.746705 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-809d8e8b-4429-46f6-9524-622e07ea9e2e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Image limits 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 03 02:56:39.746971 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-809d8e8b-4429-46f6-9524-622e07ea9e2e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Flavor pref 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 03 02:56:39.747377 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-809d8e8b-4429-46f6-9524-622e07ea9e2e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Image pref 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 03 02:56:39.747786 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-809d8e8b-4429-46f6-9524-622e07ea9e2e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 03 02:56:39.767738 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-809d8e8b-4429-46f6-9524-622e07ea9e2e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:39.768442 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-809d8e8b-4429-46f6-9524-622e07ea9e2e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:39.769559 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-809d8e8b-4429-46f6-9524-622e07ea9e2e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:39.770035 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-809d8e8b-4429-46f6-9524-622e07ea9e2e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:39.792238 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-cac08c77-bd4a-4ccb-ae64-d53822316c07 tempest-VolumesGetTestJSON-180290230 tempest-VolumesGetTestJSON-180290230-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/71c8d62a-25fa-48d2-b313-c3d71f734763" status: 200 len: 352 microversion: 2.1 time: 0.140535 Feb 03 02:56:39.793937 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 13/22] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Feb 3 02:56:39 2022] GET /compute/v2.1/os-volumes/71c8d62a-25fa-48d2-b313-c3d71f734763 => generated 352 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:56:39.797749 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-809d8e8b-4429-46f6-9524-622e07ea9e2e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Getting quotas for project 9cdfe1c1946840c19d3d559fb81e34b5. Resources: {'cores', 'ram', 'instances'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 02:56:39.801891 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-809d8e8b-4429-46f6-9524-622e07ea9e2e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Getting quotas for user f755cdacf8054a9e916ec75f1dedc105 and project 9cdfe1c1946840c19d3d559fb81e34b5. Resources: {'cores', 'ram', 'instances'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 02:56:39.803968 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-b5e44290-49cb-403c-a423-42eee1bca853 tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] Calling method '.version_select at 0x7ff99db515e0>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:39.815846 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-809d8e8b-4429-46f6-9524-622e07ea9e2e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Going to run 1 instances... {{(pid=116385) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 03 02:56:39.818090 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-809d8e8b-4429-46f6-9524-622e07ea9e2e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 03 02:56:39.867793 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-b5e44290-49cb-403c-a423-42eee1bca853 tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/b4fe8022-fe26-41ed-a08f-07802f7584de" status: 200 len: 286 microversion: 2.1 time: 0.068299 Feb 03 02:56:39.869599 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-809d8e8b-4429-46f6-9524-622e07ea9e2e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.490423 Feb 03 02:56:39.873178 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 14/23] 10.222.0.31 () {58 vars in 1250 bytes} [Thu Feb 3 02:56:39 2022] GET /compute/v2.1/os-snapshots/b4fe8022-fe26-41ed-a08f-07802f7584de => generated 286 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:56:39.875593 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 10/24] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Feb 3 02:56:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 1497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 03 02:56:39.883644 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-366459dd-c737-41d8-a572-3df82e881b8a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:39.885343 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-366459dd-c737-41d8-a572-3df82e881b8a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:40.183031 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-7fd8870b-875a-4554-9917-f9596f40f38b tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:40.183655 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-7fd8870b-875a-4554-9917-f9596f40f38b tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:40.194173 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7fd8870b-875a-4554-9917-f9596f40f38b tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:40.196316 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7fd8870b-875a-4554-9917-f9596f40f38b tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:40.197331 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7fd8870b-875a-4554-9917-f9596f40f38b tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:40.207550 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7fd8870b-875a-4554-9917-f9596f40f38b tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:40.427298 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-366459dd-c737-41d8-a572-3df82e881b8a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:40.437746 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-366459dd-c737-41d8-a572-3df82e881b8a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1221 microversion: 2.1 time: 0.559421 Feb 03 02:56:40.445834 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 15/25] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:39 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1221 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:40.552593 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-8286619f-1711-41dd-ba16-644402757694 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:40.553314 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-8286619f-1711-41dd-ba16-644402757694 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:40.568379 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-7fd8870b-875a-4554-9917-f9596f40f38b tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:40.568547 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8286619f-1711-41dd-ba16-644402757694 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:40.568967 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8286619f-1711-41dd-ba16-644402757694 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:40.569762 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8286619f-1711-41dd-ba16-644402757694 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:40.581080 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8286619f-1711-41dd-ba16-644402757694 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:40.594070 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-7fd8870b-875a-4554-9917-f9596f40f38b tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1218 microversion: 2.1 time: 0.414867 Feb 03 02:56:40.596694 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 11/26] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:40 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1218 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:56:40.738495 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-b1f78cd2-1f6a-4dc0-a9a1-a4bc9232fd6d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-930485073", "imageRef": "99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:56:40.773841 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-8286619f-1711-41dd-ba16-644402757694 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:40.785359 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-8286619f-1711-41dd-ba16-644402757694 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1222 microversion: 2.1 time: 0.237947 Feb 03 02:56:40.785946 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 16/27] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:40 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1222 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:56:40.812396 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-038580d0-0f5c-4e6f-8384-1569c30641fd tempest-VolumesGetTestJSON-180290230 tempest-VolumesGetTestJSON-180290230-project] Calling method '.version_select at 0x7ff99dba3a60>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:40.835038 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.network.neutron [None req-b1f78cd2-1f6a-4dc0-a9a1-a4bc9232fd6d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] validate_networks() for [('f43a5cf5-27e4-4762-a93b-2169348c9878', None, None, None, None, None)] {{(pid=116385) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 03 02:56:40.894625 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-038580d0-0f5c-4e6f-8384-1569c30641fd tempest-VolumesGetTestJSON-180290230 tempest-VolumesGetTestJSON-180290230-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/71c8d62a-25fa-48d2-b313-c3d71f734763" status: 200 len: 352 microversion: 2.1 time: 0.091659 Feb 03 02:56:40.901527 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 17/28] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Feb 3 02:56:40 2022] GET /compute/v2.1/os-volumes/71c8d62a-25fa-48d2-b313-c3d71f734763 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 03 02:56:40.907341 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-589bf42f-6063-422c-b7cb-2ad61c702f26 tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] Calling method '.version_select at 0x7ff99db65e50>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:40.975063 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-589bf42f-6063-422c-b7cb-2ad61c702f26 tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/b4fe8022-fe26-41ed-a08f-07802f7584de" status: 200 len: 287 microversion: 2.1 time: 0.071244 Feb 03 02:56:40.984330 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 18/29] 10.222.0.31 () {58 vars in 1250 bytes} [Thu Feb 3 02:56:40 2022] GET /compute/v2.1/os-snapshots/b4fe8022-fe26-41ed-a08f-07802f7584de => generated 287 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:56:40.991105 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-e8d5a9d0-94ec-4e04-8250-f13cf18e9aed tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] Calling method '.version_select at 0x7ff99db511f0>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:41.105792 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-e8d5a9d0-94ec-4e04-8250-f13cf18e9aed tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] 10.222.0.31 "DELETE /compute/v2.1/os-snapshots/b4fe8022-fe26-41ed-a08f-07802f7584de" status: 202 len: 0 microversion: 2.1 time: 0.119555 Feb 03 02:56:41.113579 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 19/30] 10.222.0.31 () {58 vars in 1253 bytes} [Thu Feb 3 02:56:40 2022] DELETE /compute/v2.1/os-snapshots/b4fe8022-fe26-41ed-a08f-07802f7584de => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 03 02:56:41.118549 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-970be320-0f75-4035-8e7c-1b08e22faecd tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] Calling method '.version_select at 0x7ff99dc01c10>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:41.178654 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-970be320-0f75-4035-8e7c-1b08e22faecd tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/b4fe8022-fe26-41ed-a08f-07802f7584de" status: 200 len: 286 microversion: 2.1 time: 0.063444 Feb 03 02:56:41.179404 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 20/31] 10.222.0.31 () {58 vars in 1250 bytes} [Thu Feb 3 02:56:41 2022] GET /compute/v2.1/os-snapshots/b4fe8022-fe26-41ed-a08f-07802f7584de => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:56:41.611523 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-34efc4e4-8d16-4e67-846f-78189ccc486e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:41.612134 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-34efc4e4-8d16-4e67-846f-78189ccc486e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:41.625229 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-34efc4e4-8d16-4e67-846f-78189ccc486e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:41.625824 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-34efc4e4-8d16-4e67-846f-78189ccc486e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:41.627044 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-34efc4e4-8d16-4e67-846f-78189ccc486e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:41.627613 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-34efc4e4-8d16-4e67-846f-78189ccc486e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:41.722344 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-34efc4e4-8d16-4e67-846f-78189ccc486e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:41.730194 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-34efc4e4-8d16-4e67-846f-78189ccc486e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1210 microversion: 2.1 time: 0.122281 Feb 03 02:56:41.731581 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 21/32] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:41 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1210 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:41.810326 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-eee801db-b456-436f-8330-cb3fd393ee6c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:41.813848 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-eee801db-b456-436f-8330-cb3fd393ee6c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:41.832291 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-eee801db-b456-436f-8330-cb3fd393ee6c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:41.833012 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-eee801db-b456-436f-8330-cb3fd393ee6c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:41.834205 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-eee801db-b456-436f-8330-cb3fd393ee6c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:41.835241 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-eee801db-b456-436f-8330-cb3fd393ee6c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:41.867860 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-b1f78cd2-1f6a-4dc0-a9a1-a4bc9232fd6d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Flavor limits 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 03 02:56:41.868444 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-b1f78cd2-1f6a-4dc0-a9a1-a4bc9232fd6d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Image limits 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 03 02:56:41.868762 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-b1f78cd2-1f6a-4dc0-a9a1-a4bc9232fd6d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Flavor pref 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 03 02:56:41.869472 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-b1f78cd2-1f6a-4dc0-a9a1-a4bc9232fd6d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Image pref 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 03 02:56:41.870018 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-b1f78cd2-1f6a-4dc0-a9a1-a4bc9232fd6d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 03 02:56:41.882719 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b1f78cd2-1f6a-4dc0-a9a1-a4bc9232fd6d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:41.885301 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b1f78cd2-1f6a-4dc0-a9a1-a4bc9232fd6d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:41.886390 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b1f78cd2-1f6a-4dc0-a9a1-a4bc9232fd6d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:41.889361 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b1f78cd2-1f6a-4dc0-a9a1-a4bc9232fd6d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:41.922225 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-b1f78cd2-1f6a-4dc0-a9a1-a4bc9232fd6d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Getting quotas for project 9cdfe1c1946840c19d3d559fb81e34b5. Resources: {'cores', 'ram', 'instances'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 02:56:41.930657 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-eee801db-b456-436f-8330-cb3fd393ee6c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:41.932218 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-b1f78cd2-1f6a-4dc0-a9a1-a4bc9232fd6d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Getting quotas for user f755cdacf8054a9e916ec75f1dedc105 and project 9cdfe1c1946840c19d3d559fb81e34b5. Resources: {'cores', 'ram', 'instances'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 02:56:41.939351 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-eee801db-b456-436f-8330-cb3fd393ee6c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1214 microversion: 2.1 time: 0.139970 Feb 03 02:56:41.949577 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 22/33] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:41 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1214 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:41.955444 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-5692bb33-9117-40e4-9c5e-37b1dcfe1fc6 tempest-VolumesGetTestJSON-180290230 tempest-VolumesGetTestJSON-180290230-project] Calling method '.version_select at 0x7ff99db515e0>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:41.957666 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-b1f78cd2-1f6a-4dc0-a9a1-a4bc9232fd6d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Going to run 1 instances... {{(pid=116385) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 03 02:56:41.963045 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-b1f78cd2-1f6a-4dc0-a9a1-a4bc9232fd6d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 03 02:56:42.037838 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-5692bb33-9117-40e4-9c5e-37b1dcfe1fc6 tempest-VolumesGetTestJSON-180290230 tempest-VolumesGetTestJSON-180290230-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/71c8d62a-25fa-48d2-b313-c3d71f734763" status: 200 len: 352 microversion: 2.1 time: 0.086866 Feb 03 02:56:42.038424 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 23/34] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Feb 3 02:56:41 2022] GET /compute/v2.1/os-volumes/71c8d62a-25fa-48d2-b313-c3d71f734763 => generated 352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:56:42.063459 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-b1f78cd2-1f6a-4dc0-a9a1-a4bc9232fd6d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.329827 Feb 03 02:56:42.065204 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 12/35] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Feb 3 02:56:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 1332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 03 02:56:42.075765 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-0a7936d4-999b-4cfa-8828-309c85a19025 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:42.076383 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-0a7936d4-999b-4cfa-8828-309c85a19025 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:42.200136 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-ccbe4944-832d-43cb-b888-ff1ce4c3b107 tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] Calling method '.version_select at 0x7ff99db7c820>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:42.298429 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-ccbe4944-832d-43cb-b888-ff1ce4c3b107 tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/b4fe8022-fe26-41ed-a08f-07802f7584de" status: 200 len: 286 microversion: 2.1 time: 0.111077 Feb 03 02:56:42.299956 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 13/36] 10.222.0.31 () {58 vars in 1250 bytes} [Thu Feb 3 02:56:42 2022] GET /compute/v2.1/os-snapshots/b4fe8022-fe26-41ed-a08f-07802f7584de => generated 286 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:56:42.409287 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-0a7936d4-999b-4cfa-8828-309c85a19025 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:42.427394 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-0a7936d4-999b-4cfa-8828-309c85a19025 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1221 microversion: 2.1 time: 0.352997 Feb 03 02:56:42.427394 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 24/37] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:42 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1221 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:42.747297 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-a81e2f6a-00f9-44e3-a78a-c88cb3f8b92c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:42.747982 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-a81e2f6a-00f9-44e3-a78a-c88cb3f8b92c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:42.756896 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a81e2f6a-00f9-44e3-a78a-c88cb3f8b92c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:42.757359 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a81e2f6a-00f9-44e3-a78a-c88cb3f8b92c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:42.758179 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a81e2f6a-00f9-44e3-a78a-c88cb3f8b92c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:42.758613 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a81e2f6a-00f9-44e3-a78a-c88cb3f8b92c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:42.873303 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-a81e2f6a-00f9-44e3-a78a-c88cb3f8b92c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:42.880841 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-a81e2f6a-00f9-44e3-a78a-c88cb3f8b92c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1210 microversion: 2.1 time: 0.137158 Feb 03 02:56:42.882897 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 25/38] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:42 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1210 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:42.907497 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-a95640be-8aa3-4b3f-8c03-fd59884ff97c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Action: 'create', calling method: .version_select at 0x7ff99db86670>, body: {"keypair": {"name": "tempest-keypair-1323791635"}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:56:42.941219 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-a95640be-8aa3-4b3f-8c03-fd59884ff97c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Getting quotas for project 5c189a73642b4f5ba787addbc275d4c0. Resources: {'key_pairs'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 02:56:42.945541 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-a95640be-8aa3-4b3f-8c03-fd59884ff97c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Getting quotas for user 076a8d1b26864240a8007d2ac7080e0b and project 5c189a73642b4f5ba787addbc275d4c0. Resources: {'key_pairs'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 02:56:42.957239 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-0bdb7bbf-ff96-441b-845e-0b0ef7662ae8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:42.957848 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-0bdb7bbf-ff96-441b-845e-0b0ef7662ae8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:42.966913 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0bdb7bbf-ff96-441b-845e-0b0ef7662ae8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:42.967604 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0bdb7bbf-ff96-441b-845e-0b0ef7662ae8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:42.969396 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0bdb7bbf-ff96-441b-845e-0b0ef7662ae8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:42.969833 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0bdb7bbf-ff96-441b-845e-0b0ef7662ae8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:43.069602 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-0bdb7bbf-ff96-441b-845e-0b0ef7662ae8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:43.078776 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-0bdb7bbf-ff96-441b-845e-0b0ef7662ae8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1214 microversion: 2.1 time: 0.125608 Feb 03 02:56:43.082934 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 26/39] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:42 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1214 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:56:43.094229 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-3a5a1be5-5a97-4542-ad55-1fb7180ae7ad tempest-VolumesGetTestJSON-180290230 tempest-VolumesGetTestJSON-180290230-project] Calling method '.version_select at 0x7ff99db51af0>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:43.207137 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-3a5a1be5-5a97-4542-ad55-1fb7180ae7ad tempest-VolumesGetTestJSON-180290230 tempest-VolumesGetTestJSON-180290230-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/71c8d62a-25fa-48d2-b313-c3d71f734763" status: 200 len: 352 microversion: 2.1 time: 0.122374 Feb 03 02:56:43.207780 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 27/40] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Feb 3 02:56:43 2022] GET /compute/v2.1/os-volumes/71c8d62a-25fa-48d2-b313-c3d71f734763 => generated 352 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:56:43.254577 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-a95640be-8aa3-4b3f-8c03-fd59884ff97c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Getting quotas for project 5c189a73642b4f5ba787addbc275d4c0. Resources: {'key_pairs'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 02:56:43.268412 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-a95640be-8aa3-4b3f-8c03-fd59884ff97c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Getting quotas for user 076a8d1b26864240a8007d2ac7080e0b and project 5c189a73642b4f5ba787addbc275d4c0. Resources: {'key_pairs'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 02:56:43.303403 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-a95640be-8aa3-4b3f-8c03-fd59884ff97c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.577195 Feb 03 02:56:43.307366 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 14/41] 10.222.0.31 () {60 vars in 1157 bytes} [Thu Feb 3 02:56:42 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:43.310647 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-a55c859b-c940-4891-99a8-12d12ed56511 tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] Calling method '.version_select at 0x7ff99db56820>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:43.381773 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-a55c859b-c940-4891-99a8-12d12ed56511 tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/b4fe8022-fe26-41ed-a08f-07802f7584de" status: 200 len: 286 microversion: 2.1 time: 0.075084 Feb 03 02:56:43.382497 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 28/42] 10.222.0.31 () {58 vars in 1250 bytes} [Thu Feb 3 02:56:43 2022] GET /compute/v2.1/os-snapshots/b4fe8022-fe26-41ed-a08f-07802f7584de => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 03 02:56:43.448629 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-78db8f8d-1e81-4b7d-b5e8-ce5bc03d34f1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:43.449305 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-78db8f8d-1e81-4b7d-b5e8-ce5bc03d34f1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:43.457015 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-78db8f8d-1e81-4b7d-b5e8-ce5bc03d34f1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:43.458085 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-78db8f8d-1e81-4b7d-b5e8-ce5bc03d34f1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:43.459422 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-78db8f8d-1e81-4b7d-b5e8-ce5bc03d34f1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:43.460201 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-78db8f8d-1e81-4b7d-b5e8-ce5bc03d34f1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:43.614848 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-78db8f8d-1e81-4b7d-b5e8-ce5bc03d34f1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:43.644004 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-78db8f8d-1e81-4b7d-b5e8-ce5bc03d34f1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1225 microversion: 2.1 time: 0.202679 Feb 03 02:56:43.648754 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 15/43] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:43 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1225 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:43.916978 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-4552b122-fed3-4057-8cd2-4e73630320a2 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:43.918289 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-4552b122-fed3-4057-8cd2-4e73630320a2 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:43.937260 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4552b122-fed3-4057-8cd2-4e73630320a2 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:43.937935 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4552b122-fed3-4057-8cd2-4e73630320a2 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:43.939044 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4552b122-fed3-4057-8cd2-4e73630320a2 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:43.939731 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4552b122-fed3-4057-8cd2-4e73630320a2 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:44.098849 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-3a5cabbe-5f35-4868-9ea2-f2ec72e9c8e1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:44.100786 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-3a5cabbe-5f35-4868-9ea2-f2ec72e9c8e1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:44.133828 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3a5cabbe-5f35-4868-9ea2-f2ec72e9c8e1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:44.138336 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3a5cabbe-5f35-4868-9ea2-f2ec72e9c8e1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:44.147370 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3a5cabbe-5f35-4868-9ea2-f2ec72e9c8e1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:44.147769 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3a5cabbe-5f35-4868-9ea2-f2ec72e9c8e1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:44.193315 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-4552b122-fed3-4057-8cd2-4e73630320a2 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:44.208062 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-4552b122-fed3-4057-8cd2-4e73630320a2 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1266 microversion: 2.1 time: 0.311229 Feb 03 02:56:44.211880 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 29/44] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:43 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1266 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:44.234121 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-e989472b-f608-45b4-977a-ec8f67da42e4 tempest-VolumesGetTestJSON-180290230 tempest-VolumesGetTestJSON-180290230-project] Calling method '.version_select at 0x7ff99db65ee0>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:44.311896 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.wsgi [None req-e989472b-f608-45b4-977a-ec8f67da42e4 tempest-VolumesGetTestJSON-180290230 tempest-VolumesGetTestJSON-180290230-project] HTTP exception thrown: Volume 71c8d62a-25fa-48d2-b313-c3d71f734763 could not be found. Feb 03 02:56:44.312530 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-e989472b-f608-45b4-977a-ec8f67da42e4 tempest-VolumesGetTestJSON-180290230 tempest-VolumesGetTestJSON-180290230-project] Returning 404 to user: Volume 71c8d62a-25fa-48d2-b313-c3d71f734763 could not be found. {{(pid=116386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 02:56:44.313564 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-e989472b-f608-45b4-977a-ec8f67da42e4 tempest-VolumesGetTestJSON-180290230 tempest-VolumesGetTestJSON-180290230-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/71c8d62a-25fa-48d2-b313-c3d71f734763" status: 404 len: 109 microversion: 2.1 time: 0.097604 Feb 03 02:56:44.314767 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 30/45] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Feb 3 02:56:44 2022] GET /compute/v2.1/os-volumes/71c8d62a-25fa-48d2-b313-c3d71f734763 => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 02:56:44.396054 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-cb780877-2a53-497a-831a-f4b73b5c62cb tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] Calling method '.version_select at 0x7ff99f2a51f0>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:44.418365 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-3a5cabbe-5f35-4868-9ea2-f2ec72e9c8e1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:44.445030 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-3a5cabbe-5f35-4868-9ea2-f2ec72e9c8e1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1278 microversion: 2.1 time: 0.351523 Feb 03 02:56:44.446190 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 16/46] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:44 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1278 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:44.460467 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.wsgi [None req-cb780877-2a53-497a-831a-f4b73b5c62cb tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] HTTP exception thrown: Snapshot b4fe8022-fe26-41ed-a08f-07802f7584de could not be found. Feb 03 02:56:44.461086 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-cb780877-2a53-497a-831a-f4b73b5c62cb tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] Returning 404 to user: Snapshot b4fe8022-fe26-41ed-a08f-07802f7584de could not be found. {{(pid=116386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 02:56:44.462371 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-cb780877-2a53-497a-831a-f4b73b5c62cb tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] 10.222.0.31 "GET /compute/v2.1/os-snapshots/b4fe8022-fe26-41ed-a08f-07802f7584de" status: 404 len: 111 microversion: 2.1 time: 0.069938 Feb 03 02:56:44.462742 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 31/47] 10.222.0.31 () {58 vars in 1250 bytes} [Thu Feb 3 02:56:44 2022] GET /compute/v2.1/os-snapshots/b4fe8022-fe26-41ed-a08f-07802f7584de => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 02:56:44.470632 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-829bea8c-3c8c-430a-bfc3-72c84186accf tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] Calling method '.version_select at 0x7ff99db29550>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:44.638422 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-829bea8c-3c8c-430a-bfc3-72c84186accf tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/c3e1b906-b672-4fb9-b4c4-0ee437fcff0b" status: 202 len: 0 microversion: 2.1 time: 0.171423 Feb 03 02:56:44.639516 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 17/48] 10.222.0.31 () {58 vars in 1247 bytes} [Thu Feb 3 02:56:44 2022] DELETE /compute/v2.1/os-volumes/c3e1b906-b672-4fb9-b4c4-0ee437fcff0b => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 03 02:56:44.647532 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-546b55c8-779f-48d6-9f78-cb9a859f234d tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] Calling method '.version_select at 0x7ff99dba3a60>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:44.665021 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-b693c33c-d803-4f2f-aaf2-d97c36ce9e7d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:44.666054 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-b693c33c-d803-4f2f-aaf2-d97c36ce9e7d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:44.683429 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b693c33c-d803-4f2f-aaf2-d97c36ce9e7d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:44.684623 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b693c33c-d803-4f2f-aaf2-d97c36ce9e7d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:44.689414 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b693c33c-d803-4f2f-aaf2-d97c36ce9e7d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:44.692111 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b693c33c-d803-4f2f-aaf2-d97c36ce9e7d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:44.862061 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-546b55c8-779f-48d6-9f78-cb9a859f234d tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/c3e1b906-b672-4fb9-b4c4-0ee437fcff0b" status: 200 len: 345 microversion: 2.1 time: 0.218014 Feb 03 02:56:44.863607 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 32/49] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Feb 3 02:56:44 2022] GET /compute/v2.1/os-volumes/c3e1b906-b672-4fb9-b4c4-0ee437fcff0b => generated 345 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:56:45.227734 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-a31596ac-619f-4b8d-a256-1c04398e1a6e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:45.228405 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-a31596ac-619f-4b8d-a256-1c04398e1a6e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:45.241580 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a31596ac-619f-4b8d-a256-1c04398e1a6e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:45.242062 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a31596ac-619f-4b8d-a256-1c04398e1a6e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:45.245904 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a31596ac-619f-4b8d-a256-1c04398e1a6e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:45.246350 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a31596ac-619f-4b8d-a256-1c04398e1a6e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:45.450534 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-b693c33c-d803-4f2f-aaf2-d97c36ce9e7d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:45.462731 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-b693c33c-d803-4f2f-aaf2-d97c36ce9e7d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1273 microversion: 2.1 time: 0.801929 Feb 03 02:56:45.469267 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 18/50] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:44 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1273 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:56:45.497311 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-8a8d6867-6ee3-4f1c-870b-49c8b8170c3f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:45.500056 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-8a8d6867-6ee3-4f1c-870b-49c8b8170c3f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:45.520832 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8a8d6867-6ee3-4f1c-870b-49c8b8170c3f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:45.529581 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8a8d6867-6ee3-4f1c-870b-49c8b8170c3f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:45.530608 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8a8d6867-6ee3-4f1c-870b-49c8b8170c3f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:45.531188 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8a8d6867-6ee3-4f1c-870b-49c8b8170c3f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:45.537778 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-a31596ac-619f-4b8d-a256-1c04398e1a6e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:45.548265 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-a31596ac-619f-4b8d-a256-1c04398e1a6e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1272 microversion: 2.1 time: 0.324547 Feb 03 02:56:45.553006 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 33/51] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:45 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1272 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:45.762431 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-8a8d6867-6ee3-4f1c-870b-49c8b8170c3f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:45.774742 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-8a8d6867-6ee3-4f1c-870b-49c8b8170c3f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1276 microversion: 2.1 time: 0.301366 Feb 03 02:56:45.780518 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 19/52] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:45 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1276 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:45.878370 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-92afa617-e622-40b0-a4e9-3077260110af tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] Calling method '.version_select at 0x7ff99db80e50>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:45.973422 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.wsgi [None req-92afa617-e622-40b0-a4e9-3077260110af tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] HTTP exception thrown: Volume c3e1b906-b672-4fb9-b4c4-0ee437fcff0b could not be found. Feb 03 02:56:45.974008 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-92afa617-e622-40b0-a4e9-3077260110af tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] Returning 404 to user: Volume c3e1b906-b672-4fb9-b4c4-0ee437fcff0b could not be found. {{(pid=116386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 02:56:45.975297 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-92afa617-e622-40b0-a4e9-3077260110af tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/c3e1b906-b672-4fb9-b4c4-0ee437fcff0b" status: 404 len: 109 microversion: 2.1 time: 0.103688 Feb 03 02:56:45.976370 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 34/53] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Feb 3 02:56:45 2022] GET /compute/v2.1/os-volumes/c3e1b906-b672-4fb9-b4c4-0ee437fcff0b => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 02:56:45.992947 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-3d94736d-cea5-4c8b-9605-16fb7730b3f7 tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] Calling method '.version_select at 0x7ff99d310ee0>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:46.047092 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.wsgi [None req-3d94736d-cea5-4c8b-9605-16fb7730b3f7 tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] HTTP exception thrown: Volume c3e1b906-b672-4fb9-b4c4-0ee437fcff0b could not be found. Feb 03 02:56:46.048461 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-3d94736d-cea5-4c8b-9605-16fb7730b3f7 tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] Returning 404 to user: Volume c3e1b906-b672-4fb9-b4c4-0ee437fcff0b could not be found. {{(pid=116385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 02:56:46.049583 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-3d94736d-cea5-4c8b-9605-16fb7730b3f7 tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/c3e1b906-b672-4fb9-b4c4-0ee437fcff0b" status: 404 len: 109 microversion: 2.1 time: 0.062555 Feb 03 02:56:46.050373 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 20/54] 10.222.0.31 () {58 vars in 1247 bytes} [Thu Feb 3 02:56:45 2022] DELETE /compute/v2.1/os-volumes/c3e1b906-b672-4fb9-b4c4-0ee437fcff0b => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 02:56:46.060603 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-448c304e-1729-4aa9-8a21-d77fb5f00d69 tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] Calling method '.version_select at 0x7ff99daec1f0>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:46.124554 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.wsgi [None req-448c304e-1729-4aa9-8a21-d77fb5f00d69 tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] HTTP exception thrown: Volume c3e1b906-b672-4fb9-b4c4-0ee437fcff0b could not be found. Feb 03 02:56:46.125355 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-448c304e-1729-4aa9-8a21-d77fb5f00d69 tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] Returning 404 to user: Volume c3e1b906-b672-4fb9-b4c4-0ee437fcff0b could not be found. {{(pid=116386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 02:56:46.126559 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-448c304e-1729-4aa9-8a21-d77fb5f00d69 tempest-VolumesSnapshotsTestJSON-1984814037 tempest-VolumesSnapshotsTestJSON-1984814037-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/c3e1b906-b672-4fb9-b4c4-0ee437fcff0b" status: 404 len: 109 microversion: 2.1 time: 0.071908 Feb 03 02:56:46.127666 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 35/55] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Feb 3 02:56:46 2022] GET /compute/v2.1/os-volumes/c3e1b906-b672-4fb9-b4c4-0ee437fcff0b => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 02:56:46.488582 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-acf3b5b0-a270-4ad1-b311-45e5f7b4127c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:46.489230 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-acf3b5b0-a270-4ad1-b311-45e5f7b4127c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:46.501868 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-acf3b5b0-a270-4ad1-b311-45e5f7b4127c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:46.502257 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-acf3b5b0-a270-4ad1-b311-45e5f7b4127c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:46.503047 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-acf3b5b0-a270-4ad1-b311-45e5f7b4127c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:46.503490 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-acf3b5b0-a270-4ad1-b311-45e5f7b4127c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:46.569157 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-04393587-ebbd-4232-b58a-493282d9f4d5 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:46.570700 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-04393587-ebbd-4232-b58a-493282d9f4d5 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:46.603746 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-04393587-ebbd-4232-b58a-493282d9f4d5 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:46.606339 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-04393587-ebbd-4232-b58a-493282d9f4d5 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:46.610152 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-04393587-ebbd-4232-b58a-493282d9f4d5 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:46.611589 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-04393587-ebbd-4232-b58a-493282d9f4d5 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:46.816176 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-acf3b5b0-a270-4ad1-b311-45e5f7b4127c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:46.847139 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-acf3b5b0-a270-4ad1-b311-45e5f7b4127c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1279 microversion: 2.1 time: 0.364438 Feb 03 02:56:46.857207 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 21/56] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:46 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1279 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:46.873469 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-bdb89037-bdc9-467d-a262-e05513e641d7 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:46.881339 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-bdb89037-bdc9-467d-a262-e05513e641d7 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:46.902437 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bdb89037-bdc9-467d-a262-e05513e641d7 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:46.903804 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bdb89037-bdc9-467d-a262-e05513e641d7 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:46.908183 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bdb89037-bdc9-467d-a262-e05513e641d7 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:46.909504 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bdb89037-bdc9-467d-a262-e05513e641d7 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:46.982115 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-04393587-ebbd-4232-b58a-493282d9f4d5 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:47.025851 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-04393587-ebbd-4232-b58a-493282d9f4d5 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1272 microversion: 2.1 time: 0.460006 Feb 03 02:56:47.059353 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 36/57] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:46 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1272 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:47.511526 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-bdb89037-bdc9-467d-a262-e05513e641d7 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:47.522636 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-bdb89037-bdc9-467d-a262-e05513e641d7 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1276 microversion: 2.1 time: 0.663232 Feb 03 02:56:47.534896 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 22/58] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:46 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1276 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:47.871439 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-c1715efe-f604-450b-b304-edcd7daf079c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:47.872043 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-c1715efe-f604-450b-b304-edcd7daf079c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:47.880202 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c1715efe-f604-450b-b304-edcd7daf079c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:47.880686 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c1715efe-f604-450b-b304-edcd7daf079c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:47.887631 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c1715efe-f604-450b-b304-edcd7daf079c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:47.892257 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c1715efe-f604-450b-b304-edcd7daf079c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:48.071074 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-2ad6bdd3-b0f7-4871-ab3c-b18dea2543c4 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:48.071947 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-2ad6bdd3-b0f7-4871-ab3c-b18dea2543c4 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:48.088267 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2ad6bdd3-b0f7-4871-ab3c-b18dea2543c4 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:48.090461 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2ad6bdd3-b0f7-4871-ab3c-b18dea2543c4 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:48.093680 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2ad6bdd3-b0f7-4871-ab3c-b18dea2543c4 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:48.097262 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2ad6bdd3-b0f7-4871-ab3c-b18dea2543c4 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:48.377174 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-c1715efe-f604-450b-b304-edcd7daf079c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:48.392686 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-c1715efe-f604-450b-b304-edcd7daf079c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1279 microversion: 2.1 time: 0.524850 Feb 03 02:56:48.406546 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 37/59] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:47 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1279 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:48.539505 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-c06b27d8-4fac-4f99-a2fa-b4c2529c3b21 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:48.540531 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-c06b27d8-4fac-4f99-a2fa-b4c2529c3b21 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:48.554372 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c06b27d8-4fac-4f99-a2fa-b4c2529c3b21 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:48.555100 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c06b27d8-4fac-4f99-a2fa-b4c2529c3b21 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:48.559313 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c06b27d8-4fac-4f99-a2fa-b4c2529c3b21 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:48.559985 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c06b27d8-4fac-4f99-a2fa-b4c2529c3b21 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:48.931156 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-2ad6bdd3-b0f7-4871-ab3c-b18dea2543c4 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:48.940231 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-2ad6bdd3-b0f7-4871-ab3c-b18dea2543c4 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1314 microversion: 2.1 time: 0.875777 Feb 03 02:56:48.947696 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 23/60] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:48 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1314 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:49.385875 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-c06b27d8-4fac-4f99-a2fa-b4c2529c3b21 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:49.414522 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-c06b27d8-4fac-4f99-a2fa-b4c2529c3b21 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1318 microversion: 2.1 time: 0.866403 Feb 03 02:56:49.414700 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-3e10c139-f10a-4574-be52-3c9f1042bebb tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:49.414700 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-3e10c139-f10a-4574-be52-3c9f1042bebb tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:49.420616 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 38/61] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:48 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1318 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:49.433958 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3e10c139-f10a-4574-be52-3c9f1042bebb tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:49.434514 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3e10c139-f10a-4574-be52-3c9f1042bebb tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:49.435770 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3e10c139-f10a-4574-be52-3c9f1042bebb tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:49.436411 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3e10c139-f10a-4574-be52-3c9f1042bebb tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:49.614483 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-3e10c139-f10a-4574-be52-3c9f1042bebb tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:49.630877 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-3e10c139-f10a-4574-be52-3c9f1042bebb tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1279 microversion: 2.1 time: 0.218811 Feb 03 02:56:49.634463 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 24/62] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:49 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1279 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:49.966028 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-1c093335-fd02-4f27-a322-86bb9197e419 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:49.967135 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-1c093335-fd02-4f27-a322-86bb9197e419 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:49.984111 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1c093335-fd02-4f27-a322-86bb9197e419 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:49.988192 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1c093335-fd02-4f27-a322-86bb9197e419 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:49.992003 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1c093335-fd02-4f27-a322-86bb9197e419 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:49.996529 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1c093335-fd02-4f27-a322-86bb9197e419 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:50.432765 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-5d288f35-31e9-4d47-a80a-3ebaaa6d0d94 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:50.433516 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-5d288f35-31e9-4d47-a80a-3ebaaa6d0d94 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:50.446010 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5d288f35-31e9-4d47-a80a-3ebaaa6d0d94 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:50.448107 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5d288f35-31e9-4d47-a80a-3ebaaa6d0d94 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:50.449109 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5d288f35-31e9-4d47-a80a-3ebaaa6d0d94 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:50.452148 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5d288f35-31e9-4d47-a80a-3ebaaa6d0d94 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:51.329440 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-1c093335-fd02-4f27-a322-86bb9197e419 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:51.356135 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-1c093335-fd02-4f27-a322-86bb9197e419 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1314 microversion: 2.1 time: 1.397013 Feb 03 02:56:51.370864 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 39/63] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:49 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1314 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:56:51.376616 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-5d288f35-31e9-4d47-a80a-3ebaaa6d0d94 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:51.387276 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-5d288f35-31e9-4d47-a80a-3ebaaa6d0d94 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1318 microversion: 2.1 time: 0.956826 Feb 03 02:56:51.388565 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 25/64] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:50 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1318 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:56:51.401300 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-fb7a4cec-ba94-4a8e-bcab-9e0a93d35649 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:51.403671 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-fb7a4cec-ba94-4a8e-bcab-9e0a93d35649 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:51.427097 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fb7a4cec-ba94-4a8e-bcab-9e0a93d35649 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:51.428747 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fb7a4cec-ba94-4a8e-bcab-9e0a93d35649 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:51.429907 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fb7a4cec-ba94-4a8e-bcab-9e0a93d35649 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:51.430763 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fb7a4cec-ba94-4a8e-bcab-9e0a93d35649 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:52.375016 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-14d8f90b-b878-458c-b138-a85c697cf90a tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:52.376529 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-14d8f90b-b878-458c-b138-a85c697cf90a tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:52.392941 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-14d8f90b-b878-458c-b138-a85c697cf90a tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:52.394143 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-14d8f90b-b878-458c-b138-a85c697cf90a tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:52.395435 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-14d8f90b-b878-458c-b138-a85c697cf90a tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:52.398953 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-14d8f90b-b878-458c-b138-a85c697cf90a tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:52.510655 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-fb7a4cec-ba94-4a8e-bcab-9e0a93d35649 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:52.530172 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-fb7a4cec-ba94-4a8e-bcab-9e0a93d35649 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1321 microversion: 2.1 time: 1.155982 Feb 03 02:56:52.539258 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 40/65] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:51 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1321 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:52.545569 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-1f8728e8-e6f7-4be9-9437-6397b50ebf0a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:52.546266 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-1f8728e8-e6f7-4be9-9437-6397b50ebf0a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:52.567796 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1f8728e8-e6f7-4be9-9437-6397b50ebf0a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:52.567796 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1f8728e8-e6f7-4be9-9437-6397b50ebf0a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:52.576555 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1f8728e8-e6f7-4be9-9437-6397b50ebf0a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:52.583756 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1f8728e8-e6f7-4be9-9437-6397b50ebf0a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:53.252320 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-14d8f90b-b878-458c-b138-a85c697cf90a tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:53.259826 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-14d8f90b-b878-458c-b138-a85c697cf90a tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1314 microversion: 2.1 time: 0.888452 Feb 03 02:56:53.260408 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 26/66] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:52 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1314 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:53.310019 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-1f8728e8-e6f7-4be9-9437-6397b50ebf0a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:53.320429 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-1f8728e8-e6f7-4be9-9437-6397b50ebf0a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1318 microversion: 2.1 time: 0.779915 Feb 03 02:56:53.325329 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 41/67] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:52 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1318 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:53.406252 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-517076a8-6d46-4a89-b0ba-766ded8cc40b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1893034057", "imageRef": "99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6402c879-2200-432c-9a4b-8fd0476dc339"}], "security_groups": [{"name": "tempest-securitygroup--1343458862"}], "key_name": "tempest-keypair-1323791635", "user_data": "}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:56:53.494296 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-07a30bd5-b6ac-4d93-aedd-bdeb89ecc040 req-961627d5-b949-4a30-be73-ee1fb04ba576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e", "tag": "514f132e-1831-4333-8bbe-abcdacde0949"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:56:53.498081 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:56:53.498081 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 02:56:53.509251 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-07a30bd5-b6ac-4d93-aedd-bdeb89ecc040 req-961627d5-b949-4a30-be73-ee1fb04ba576 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:53.509843 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-07a30bd5-b6ac-4d93-aedd-bdeb89ecc040 req-961627d5-b949-4a30-be73-ee1fb04ba576 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:53.530996 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-07a30bd5-b6ac-4d93-aedd-bdeb89ecc040 req-961627d5-b949-4a30-be73-ee1fb04ba576 service nova] Creating event network-changed:514f132e-1831-4333-8bbe-abcdacde0949 for instance 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e on hv-cinder-82758 Feb 03 02:56:53.531556 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-07a30bd5-b6ac-4d93-aedd-bdeb89ecc040 req-961627d5-b949-4a30-be73-ee1fb04ba576 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116385) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 03 02:56:53.532906 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fc83da68-f586-4668-b0f3-1fc9f32cd7d6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:53.533526 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fc83da68-f586-4668-b0f3-1fc9f32cd7d6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:53.534611 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fc83da68-f586-4668-b0f3-1fc9f32cd7d6 None None] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:53.535190 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fc83da68-f586-4668-b0f3-1fc9f32cd7d6 None None] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:53.545247 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.compute.rpcapi [None req-fc83da68-f586-4668-b0f3-1fc9f32cd7d6 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Feb 03 02:56:53.546239 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fc83da68-f586-4668-b0f3-1fc9f32cd7d6 None None] Releasing lock "compute-rpcapi-router" {{(pid=116385) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 03 02:56:53.570056 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.network.neutron [None req-517076a8-6d46-4a89-b0ba-766ded8cc40b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] validate_networks() for [('6402c879-2200-432c-9a4b-8fd0476dc339', None, None, None, None, None)] {{(pid=116386) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 03 02:56:53.572238 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-fc83da68-f586-4668-b0f3-1fc9f32cd7d6 None None] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.279897 Feb 03 02:56:53.576371 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 27/68] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:56:53.642782 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-01fefb8c-bc26-4863-88c6-53424db191da req-f7265bb2-af4d-4035-b20a-9a3eec867bab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "933b2272-897b-43bc-8ba0-252edeef0170", "tag": "44de70aa-dd5c-4b82-94f1-25e286c3f42f"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:56:53.645274 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:56:53.645274 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 02:56:53.653237 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-01fefb8c-bc26-4863-88c6-53424db191da req-f7265bb2-af4d-4035-b20a-9a3eec867bab service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:53.653684 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-01fefb8c-bc26-4863-88c6-53424db191da req-f7265bb2-af4d-4035-b20a-9a3eec867bab service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:53.664230 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-01fefb8c-bc26-4863-88c6-53424db191da req-f7265bb2-af4d-4035-b20a-9a3eec867bab service nova] Creating event network-changed:44de70aa-dd5c-4b82-94f1-25e286c3f42f for instance 933b2272-897b-43bc-8ba0-252edeef0170 on hv-cinder-82758 Feb 03 02:56:53.669136 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-01fefb8c-bc26-4863-88c6-53424db191da req-f7265bb2-af4d-4035-b20a-9a3eec867bab service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091200 Feb 03 02:56:53.669738 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 28/69] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:56:53.674698 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-1cd43fa0-9049-4827-8c48-1519a07dfd6c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:53.675746 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-1cd43fa0-9049-4827-8c48-1519a07dfd6c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:53.681968 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1cd43fa0-9049-4827-8c48-1519a07dfd6c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:53.682631 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1cd43fa0-9049-4827-8c48-1519a07dfd6c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:53.683640 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1cd43fa0-9049-4827-8c48-1519a07dfd6c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:53.684027 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1cd43fa0-9049-4827-8c48-1519a07dfd6c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:53.973012 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-1cd43fa0-9049-4827-8c48-1519a07dfd6c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:53.981444 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-1cd43fa0-9049-4827-8c48-1519a07dfd6c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1321 microversion: 2.1 time: 0.310397 Feb 03 02:56:53.987383 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 29/70] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:53 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:54.168252 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-517076a8-6d46-4a89-b0ba-766ded8cc40b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Flavor limits 0:0:0 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 03 02:56:54.168678 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-517076a8-6d46-4a89-b0ba-766ded8cc40b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Image limits 0:0:0 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 03 02:56:54.169207 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-517076a8-6d46-4a89-b0ba-766ded8cc40b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Flavor pref 0:0:0 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 03 02:56:54.169614 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-517076a8-6d46-4a89-b0ba-766ded8cc40b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Image pref 0:0:0 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 03 02:56:54.170030 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-517076a8-6d46-4a89-b0ba-766ded8cc40b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 03 02:56:54.178421 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-517076a8-6d46-4a89-b0ba-766ded8cc40b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:54.178865 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-517076a8-6d46-4a89-b0ba-766ded8cc40b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:54.179666 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-517076a8-6d46-4a89-b0ba-766ded8cc40b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:54.180097 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-517076a8-6d46-4a89-b0ba-766ded8cc40b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:54.201479 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.quota [None req-517076a8-6d46-4a89-b0ba-766ded8cc40b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Getting quotas for project 5c189a73642b4f5ba787addbc275d4c0. Resources: {'cores', 'ram', 'instances'} {{(pid=116386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 02:56:54.205511 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.quota [None req-517076a8-6d46-4a89-b0ba-766ded8cc40b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Getting quotas for user 076a8d1b26864240a8007d2ac7080e0b and project 5c189a73642b4f5ba787addbc275d4c0. Resources: {'cores', 'ram', 'instances'} {{(pid=116386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 02:56:54.216449 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-517076a8-6d46-4a89-b0ba-766ded8cc40b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Going to run 1 instances... {{(pid=116386) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 03 02:56:54.218675 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-517076a8-6d46-4a89-b0ba-766ded8cc40b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 03 02:56:54.265651 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-517076a8-6d46-4a89-b0ba-766ded8cc40b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.864994 Feb 03 02:56:54.272847 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 42/71] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Feb 3 02:56:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 03 02:56:54.277442 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-a68cab23-7b5a-4468-894a-064e8e58525e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:54.278048 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-a68cab23-7b5a-4468-894a-064e8e58525e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:54.281548 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-f9e122c0-95ff-4ace-bcdf-d9dafd663c07 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:54.282598 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-f9e122c0-95ff-4ace-bcdf-d9dafd663c07 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:54.292554 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f9e122c0-95ff-4ace-bcdf-d9dafd663c07 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:54.293228 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f9e122c0-95ff-4ace-bcdf-d9dafd663c07 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:54.294620 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f9e122c0-95ff-4ace-bcdf-d9dafd663c07 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:54.295256 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f9e122c0-95ff-4ace-bcdf-d9dafd663c07 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:54.333287 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-a68cab23-7b5a-4468-894a-064e8e58525e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:54.342613 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-a68cab23-7b5a-4468-894a-064e8e58525e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1238 microversion: 2.1 time: 0.068673 Feb 03 02:56:54.343833 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 43/72] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:54 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:54.360066 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-a0e031d6-15a1-4143-98cd-2c5a350859f8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:54.361281 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-a0e031d6-15a1-4143-98cd-2c5a350859f8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:54.368480 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a0e031d6-15a1-4143-98cd-2c5a350859f8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:54.368962 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a0e031d6-15a1-4143-98cd-2c5a350859f8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:54.369927 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a0e031d6-15a1-4143-98cd-2c5a350859f8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:54.370351 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a0e031d6-15a1-4143-98cd-2c5a350859f8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:54.492411 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-f9e122c0-95ff-4ace-bcdf-d9dafd663c07 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:54.499840 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-f9e122c0-95ff-4ace-bcdf-d9dafd663c07 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1314 microversion: 2.1 time: 0.225362 Feb 03 02:56:54.502132 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 30/73] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:54 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:56:54.578746 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-a0e031d6-15a1-4143-98cd-2c5a350859f8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:54.588013 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-a0e031d6-15a1-4143-98cd-2c5a350859f8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1318 microversion: 2.1 time: 0.242791 Feb 03 02:56:54.588609 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 44/74] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:54 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:54.998709 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-204b38a4-98d7-4ca7-b7ff-c71e91808205 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:54.999596 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-204b38a4-98d7-4ca7-b7ff-c71e91808205 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:55.007139 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-204b38a4-98d7-4ca7-b7ff-c71e91808205 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:55.009267 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-204b38a4-98d7-4ca7-b7ff-c71e91808205 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:55.010850 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-204b38a4-98d7-4ca7-b7ff-c71e91808205 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:55.011608 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-204b38a4-98d7-4ca7-b7ff-c71e91808205 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:55.232984 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-204b38a4-98d7-4ca7-b7ff-c71e91808205 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:55.244659 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-204b38a4-98d7-4ca7-b7ff-c71e91808205 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1321 microversion: 2.1 time: 0.249702 Feb 03 02:56:55.246039 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 31/75] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:54 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:55.359795 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-44f4e792-f4ba-4e35-ab4c-bdb24c5a7931 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:55.360401 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-44f4e792-f4ba-4e35-ab4c-bdb24c5a7931 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:55.374321 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-44f4e792-f4ba-4e35-ab4c-bdb24c5a7931 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:55.374943 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-44f4e792-f4ba-4e35-ab4c-bdb24c5a7931 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:55.376025 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-44f4e792-f4ba-4e35-ab4c-bdb24c5a7931 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:55.376631 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-44f4e792-f4ba-4e35-ab4c-bdb24c5a7931 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:55.482397 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-44f4e792-f4ba-4e35-ab4c-bdb24c5a7931 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:55.491180 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-44f4e792-f4ba-4e35-ab4c-bdb24c5a7931 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1242 microversion: 2.1 time: 0.134778 Feb 03 02:56:55.492175 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 45/76] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:55 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1242 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:55.517969 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-6ac2af06-0630-49f0-ae31-5a9b85c5c40c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:55.518638 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-6ac2af06-0630-49f0-ae31-5a9b85c5c40c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:55.527069 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6ac2af06-0630-49f0-ae31-5a9b85c5c40c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:55.527483 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6ac2af06-0630-49f0-ae31-5a9b85c5c40c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:55.530754 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6ac2af06-0630-49f0-ae31-5a9b85c5c40c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:55.532268 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6ac2af06-0630-49f0-ae31-5a9b85c5c40c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:55.606541 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-b6a0e172-7faa-420c-a1e9-021944c08b87 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:55.608172 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-b6a0e172-7faa-420c-a1e9-021944c08b87 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:55.619550 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b6a0e172-7faa-420c-a1e9-021944c08b87 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:55.621464 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b6a0e172-7faa-420c-a1e9-021944c08b87 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:55.625256 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b6a0e172-7faa-420c-a1e9-021944c08b87 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:55.626227 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b6a0e172-7faa-420c-a1e9-021944c08b87 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:55.930091 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-6ac2af06-0630-49f0-ae31-5a9b85c5c40c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:55.937540 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-6ac2af06-0630-49f0-ae31-5a9b85c5c40c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1314 microversion: 2.1 time: 0.424430 Feb 03 02:56:55.940312 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 32/77] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:55 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:55.959155 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-cff0297e-51b7-4005-881d-0cfedfedb78f req-156c0b59-e9c9-4dea-9886-24cdb2c935a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2abf9364-36a9-416e-831f-00f7508465bd", "tag": "56bc6508-b90c-4a56-92a7-ede9dab41a4f"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:56:55.965798 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:56:55.965798 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 02:56:55.983389 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-cff0297e-51b7-4005-881d-0cfedfedb78f req-156c0b59-e9c9-4dea-9886-24cdb2c935a0 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:55.984311 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-cff0297e-51b7-4005-881d-0cfedfedb78f req-156c0b59-e9c9-4dea-9886-24cdb2c935a0 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:56.007248 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-cff0297e-51b7-4005-881d-0cfedfedb78f req-156c0b59-e9c9-4dea-9886-24cdb2c935a0 service nova] Creating event network-changed:56bc6508-b90c-4a56-92a7-ede9dab41a4f for instance 2abf9364-36a9-416e-831f-00f7508465bd on hv-cinder-82758 Feb 03 02:56:56.015978 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-b6a0e172-7faa-420c-a1e9-021944c08b87 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:56.020752 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-cff0297e-51b7-4005-881d-0cfedfedb78f req-156c0b59-e9c9-4dea-9886-24cdb2c935a0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079682 Feb 03 02:56:56.021949 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 33/78] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:56:56.026033 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-b6a0e172-7faa-420c-a1e9-021944c08b87 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1318 microversion: 2.1 time: 0.424375 Feb 03 02:56:56.034466 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 46/79] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:55 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1318 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:56:56.043385 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-6f2f5edf-6da5-4904-a27f-9767fedabb39 req-e5ef4387-6bde-4a3b-9c8a-f442fb7bff96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34add2e5-8d7d-42c6-8f4c-e7a60fb27183", "tag": "4f976c37-c124-473b-94e5-f47a2ad3d40b"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:56:56.045444 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:56:56.045444 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 02:56:56.062392 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-6f2f5edf-6da5-4904-a27f-9767fedabb39 req-e5ef4387-6bde-4a3b-9c8a-f442fb7bff96 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:56.062832 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-6f2f5edf-6da5-4904-a27f-9767fedabb39 req-e5ef4387-6bde-4a3b-9c8a-f442fb7bff96 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:56.092708 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-6f2f5edf-6da5-4904-a27f-9767fedabb39 req-e5ef4387-6bde-4a3b-9c8a-f442fb7bff96 service nova] Creating event network-changed:4f976c37-c124-473b-94e5-f47a2ad3d40b for instance 34add2e5-8d7d-42c6-8f4c-e7a60fb27183 on hv-cinder-82758 Feb 03 02:56:56.102686 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-6f2f5edf-6da5-4904-a27f-9767fedabb39 req-e5ef4387-6bde-4a3b-9c8a-f442fb7bff96 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079234 Feb 03 02:56:56.105480 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 34/80] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:56:56.266823 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-d1550eb4-ebb3-4f9f-9b1a-15e8734edacf tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:56.267449 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-d1550eb4-ebb3-4f9f-9b1a-15e8734edacf tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:56.286796 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d1550eb4-ebb3-4f9f-9b1a-15e8734edacf tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:56.288100 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d1550eb4-ebb3-4f9f-9b1a-15e8734edacf tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:56.290132 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d1550eb4-ebb3-4f9f-9b1a-15e8734edacf tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:56.291737 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d1550eb4-ebb3-4f9f-9b1a-15e8734edacf tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:56.517952 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-0a1efefe-c7cc-4d36-b7b3-e312c893d63c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:56.519676 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-0a1efefe-c7cc-4d36-b7b3-e312c893d63c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:56.544025 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0a1efefe-c7cc-4d36-b7b3-e312c893d63c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:56.544608 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0a1efefe-c7cc-4d36-b7b3-e312c893d63c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:56.549640 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0a1efefe-c7cc-4d36-b7b3-e312c893d63c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:56.550087 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0a1efefe-c7cc-4d36-b7b3-e312c893d63c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:56.659115 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-d1550eb4-ebb3-4f9f-9b1a-15e8734edacf tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:56.667873 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-d1550eb4-ebb3-4f9f-9b1a-15e8734edacf tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1321 microversion: 2.1 time: 0.409609 Feb 03 02:56:56.681595 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 47/81] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:56 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1321 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:56.706580 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-0a1efefe-c7cc-4d36-b7b3-e312c893d63c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:56.727117 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-0a1efefe-c7cc-4d36-b7b3-e312c893d63c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1242 microversion: 2.1 time: 0.220161 Feb 03 02:56:56.730801 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 35/82] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:56 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1242 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:56.957151 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-752504fd-f446-465f-b1a0-992911d0a967 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:56.957766 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-752504fd-f446-465f-b1a0-992911d0a967 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:56.965755 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-752504fd-f446-465f-b1a0-992911d0a967 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:56.966492 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-752504fd-f446-465f-b1a0-992911d0a967 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:56.967719 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-752504fd-f446-465f-b1a0-992911d0a967 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:56.968620 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-752504fd-f446-465f-b1a0-992911d0a967 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:57.046916 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-d730a624-9eb9-4105-82a4-09188493f65f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:57.048271 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-d730a624-9eb9-4105-82a4-09188493f65f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:57.063632 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d730a624-9eb9-4105-82a4-09188493f65f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:57.065835 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d730a624-9eb9-4105-82a4-09188493f65f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:57.075349 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d730a624-9eb9-4105-82a4-09188493f65f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:57.076096 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d730a624-9eb9-4105-82a4-09188493f65f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:57.355387 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-752504fd-f446-465f-b1a0-992911d0a967 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:57.365100 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-752504fd-f446-465f-b1a0-992911d0a967 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1314 microversion: 2.1 time: 0.412011 Feb 03 02:56:57.378096 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 48/83] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:56 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:57.477579 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-d730a624-9eb9-4105-82a4-09188493f65f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:57.487390 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-d730a624-9eb9-4105-82a4-09188493f65f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1318 microversion: 2.1 time: 0.448301 Feb 03 02:56:57.487960 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 36/84] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:57 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1318 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:56:57.688807 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-d97b645e-2c85-40da-b9b0-1fe0ae4fbb5b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:57.689752 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-d97b645e-2c85-40da-b9b0-1fe0ae4fbb5b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:57.701736 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d97b645e-2c85-40da-b9b0-1fe0ae4fbb5b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:57.702191 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d97b645e-2c85-40da-b9b0-1fe0ae4fbb5b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:57.703013 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d97b645e-2c85-40da-b9b0-1fe0ae4fbb5b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:57.703509 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d97b645e-2c85-40da-b9b0-1fe0ae4fbb5b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:57.746904 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-b1008ee5-dc9d-47a7-a768-ed4406085c2c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:57.748344 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-b1008ee5-dc9d-47a7-a768-ed4406085c2c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:57.755316 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b1008ee5-dc9d-47a7-a768-ed4406085c2c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:57.756086 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b1008ee5-dc9d-47a7-a768-ed4406085c2c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:57.757553 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b1008ee5-dc9d-47a7-a768-ed4406085c2c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:57.758346 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b1008ee5-dc9d-47a7-a768-ed4406085c2c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:57.926130 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-b1008ee5-dc9d-47a7-a768-ed4406085c2c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:57.952005 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-b1008ee5-dc9d-47a7-a768-ed4406085c2c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1242 microversion: 2.1 time: 0.208158 Feb 03 02:56:57.954723 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 37/85] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:57 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1242 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:58.075934 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-d97b645e-2c85-40da-b9b0-1fe0ae4fbb5b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:58.106523 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-d97b645e-2c85-40da-b9b0-1fe0ae4fbb5b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1321 microversion: 2.1 time: 0.422650 Feb 03 02:56:58.112344 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 49/86] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:57 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1321 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:58.384175 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-4e6f1245-eb11-4a3f-b72a-65645e55d39b tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:58.386092 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-4e6f1245-eb11-4a3f-b72a-65645e55d39b tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:58.400410 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4e6f1245-eb11-4a3f-b72a-65645e55d39b tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:58.400889 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4e6f1245-eb11-4a3f-b72a-65645e55d39b tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:58.401675 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4e6f1245-eb11-4a3f-b72a-65645e55d39b tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:58.402262 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4e6f1245-eb11-4a3f-b72a-65645e55d39b tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:58.505910 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-8ff8d965-8bec-4d86-9117-08aa5c3f7fc7 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:58.507349 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-8ff8d965-8bec-4d86-9117-08aa5c3f7fc7 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:58.518354 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8ff8d965-8bec-4d86-9117-08aa5c3f7fc7 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:58.518790 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8ff8d965-8bec-4d86-9117-08aa5c3f7fc7 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:58.519578 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8ff8d965-8bec-4d86-9117-08aa5c3f7fc7 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:58.520028 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8ff8d965-8bec-4d86-9117-08aa5c3f7fc7 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:58.632391 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-4e6f1245-eb11-4a3f-b72a-65645e55d39b tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:58.643289 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-4e6f1245-eb11-4a3f-b72a-65645e55d39b tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1314 microversion: 2.1 time: 0.263522 Feb 03 02:56:58.653802 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 38/87] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:58 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:58.700926 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-8ff8d965-8bec-4d86-9117-08aa5c3f7fc7 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:58.714174 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-8ff8d965-8bec-4d86-9117-08aa5c3f7fc7 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1318 microversion: 2.1 time: 0.213003 Feb 03 02:56:58.714745 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 50/88] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:58 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:56:58.974237 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-0259663b-f62e-4e1c-839f-40e4fcf2d112 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:58.974845 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-0259663b-f62e-4e1c-839f-40e4fcf2d112 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:58.982642 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0259663b-f62e-4e1c-839f-40e4fcf2d112 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:58.983082 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0259663b-f62e-4e1c-839f-40e4fcf2d112 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:58.983867 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0259663b-f62e-4e1c-839f-40e4fcf2d112 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:58.984288 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0259663b-f62e-4e1c-839f-40e4fcf2d112 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:59.064122 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-0259663b-f62e-4e1c-839f-40e4fcf2d112 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:59.078827 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-0259663b-f62e-4e1c-839f-40e4fcf2d112 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1242 microversion: 2.1 time: 0.112125 Feb 03 02:56:59.088078 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 39/89] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:58 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1242 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:59.128809 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-bb6cfa03-9b11-4850-ac1d-7b280d9001da tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:59.129619 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-bb6cfa03-9b11-4850-ac1d-7b280d9001da tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:59.150435 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-bb6cfa03-9b11-4850-ac1d-7b280d9001da tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:59.150883 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-bb6cfa03-9b11-4850-ac1d-7b280d9001da tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:59.153482 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-bb6cfa03-9b11-4850-ac1d-7b280d9001da tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:59.153918 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-bb6cfa03-9b11-4850-ac1d-7b280d9001da tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:59.426995 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-bb6cfa03-9b11-4850-ac1d-7b280d9001da tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:59.437298 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-bb6cfa03-9b11-4850-ac1d-7b280d9001da tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1321 microversion: 2.1 time: 0.311588 Feb 03 02:56:59.448382 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 51/90] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:59 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1321 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:59.669421 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-80b13ba9-7503-41b7-a3a3-9ebdbfe0dbfb tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:59.669825 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-80b13ba9-7503-41b7-a3a3-9ebdbfe0dbfb tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:59.677434 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-80b13ba9-7503-41b7-a3a3-9ebdbfe0dbfb tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:59.677872 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-80b13ba9-7503-41b7-a3a3-9ebdbfe0dbfb tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:59.680785 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-80b13ba9-7503-41b7-a3a3-9ebdbfe0dbfb tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:59.682648 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-80b13ba9-7503-41b7-a3a3-9ebdbfe0dbfb tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:59.733497 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-07ce59b7-80ca-483d-8db1-fad689239061 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:56:59.734926 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-07ce59b7-80ca-483d-8db1-fad689239061 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:56:59.744125 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-07ce59b7-80ca-483d-8db1-fad689239061 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:59.744933 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-07ce59b7-80ca-483d-8db1-fad689239061 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:59.746009 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-07ce59b7-80ca-483d-8db1-fad689239061 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:56:59.746446 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-07ce59b7-80ca-483d-8db1-fad689239061 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:56:59.903034 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-80b13ba9-7503-41b7-a3a3-9ebdbfe0dbfb tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:59.910335 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-80b13ba9-7503-41b7-a3a3-9ebdbfe0dbfb tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1314 microversion: 2.1 time: 0.252669 Feb 03 02:56:59.911163 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 40/91] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:59 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:56:59.962157 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-07ce59b7-80ca-483d-8db1-fad689239061 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:56:59.971131 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-07ce59b7-80ca-483d-8db1-fad689239061 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1318 microversion: 2.1 time: 0.242918 Feb 03 02:56:59.971644 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 52/92] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:56:59 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:00.104691 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-bb6e3b13-e432-4aa6-bfe6-00b10d51f032 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:00.105306 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-bb6e3b13-e432-4aa6-bfe6-00b10d51f032 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:00.112368 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bb6e3b13-e432-4aa6-bfe6-00b10d51f032 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:00.113061 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bb6e3b13-e432-4aa6-bfe6-00b10d51f032 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:00.114109 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bb6e3b13-e432-4aa6-bfe6-00b10d51f032 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:00.114531 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bb6e3b13-e432-4aa6-bfe6-00b10d51f032 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:00.178751 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-bb6e3b13-e432-4aa6-bfe6-00b10d51f032 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:00.188868 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-bb6e3b13-e432-4aa6-bfe6-00b10d51f032 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1242 microversion: 2.1 time: 0.088936 Feb 03 02:57:00.190201 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 41/93] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:00 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:00.455035 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-d9c736fb-bb09-4710-920c-8464453c693f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:00.455915 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-d9c736fb-bb09-4710-920c-8464453c693f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:00.462758 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d9c736fb-bb09-4710-920c-8464453c693f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:00.463580 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d9c736fb-bb09-4710-920c-8464453c693f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:00.464823 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d9c736fb-bb09-4710-920c-8464453c693f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:00.465564 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d9c736fb-bb09-4710-920c-8464453c693f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:00.920626 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-d9c736fb-bb09-4710-920c-8464453c693f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:00.927570 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-f6f88e5c-96f6-4324-b04a-bd78d5b7b9d1 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:00.928099 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-f6f88e5c-96f6-4324-b04a-bd78d5b7b9d1 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:00.934224 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f6f88e5c-96f6-4324-b04a-bd78d5b7b9d1 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:00.935524 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f6f88e5c-96f6-4324-b04a-bd78d5b7b9d1 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:00.936544 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f6f88e5c-96f6-4324-b04a-bd78d5b7b9d1 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:00.937154 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f6f88e5c-96f6-4324-b04a-bd78d5b7b9d1 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:00.950288 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-d9c736fb-bb09-4710-920c-8464453c693f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1321 microversion: 2.1 time: 0.494827 Feb 03 02:57:00.957825 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 53/94] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:00 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1321 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:00.990564 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-e8b073cf-8ea0-4709-9371-4c1bfa9e83fa tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:00.991439 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-e8b073cf-8ea0-4709-9371-4c1bfa9e83fa tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:01.000834 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e8b073cf-8ea0-4709-9371-4c1bfa9e83fa tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:01.001634 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e8b073cf-8ea0-4709-9371-4c1bfa9e83fa tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:01.002580 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e8b073cf-8ea0-4709-9371-4c1bfa9e83fa tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:01.003159 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e8b073cf-8ea0-4709-9371-4c1bfa9e83fa tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:01.769632 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-f6f88e5c-96f6-4324-b04a-bd78d5b7b9d1 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:01.783496 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-f6f88e5c-96f6-4324-b04a-bd78d5b7b9d1 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1314 microversion: 2.1 time: 0.859757 Feb 03 02:57:01.784621 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 42/95] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:00 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1314 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:01.789086 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-6b1362f5-0d74-46be-8bb0-dd91cfe0c237 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:01.789888 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-6b1362f5-0d74-46be-8bb0-dd91cfe0c237 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:01.802019 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6b1362f5-0d74-46be-8bb0-dd91cfe0c237 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:01.804199 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6b1362f5-0d74-46be-8bb0-dd91cfe0c237 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:01.805929 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6b1362f5-0d74-46be-8bb0-dd91cfe0c237 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:01.819616 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6b1362f5-0d74-46be-8bb0-dd91cfe0c237 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:01.835429 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-e8b073cf-8ea0-4709-9371-4c1bfa9e83fa tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:01.849189 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-e8b073cf-8ea0-4709-9371-4c1bfa9e83fa tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1318 microversion: 2.1 time: 0.864463 Feb 03 02:57:01.850403 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 54/96] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:00 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1318 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:01.969246 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-4ea3e528-4dd4-4309-8b73-1b8fbc5915cf tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:01.971068 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-4ea3e528-4dd4-4309-8b73-1b8fbc5915cf tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:01.982085 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4ea3e528-4dd4-4309-8b73-1b8fbc5915cf tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:01.985374 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4ea3e528-4dd4-4309-8b73-1b8fbc5915cf tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:01.986488 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4ea3e528-4dd4-4309-8b73-1b8fbc5915cf tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:01.987071 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4ea3e528-4dd4-4309-8b73-1b8fbc5915cf tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:01.991594 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-6b1362f5-0d74-46be-8bb0-dd91cfe0c237 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:02.005168 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-6b1362f5-0d74-46be-8bb0-dd91cfe0c237 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1296 microversion: 2.1 time: 0.215814 Feb 03 02:57:02.005884 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 43/97] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:01 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1296 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:02.601814 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-4ea3e528-4dd4-4309-8b73-1b8fbc5915cf tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:02.611421 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-4ea3e528-4dd4-4309-8b73-1b8fbc5915cf tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1321 microversion: 2.1 time: 0.646575 Feb 03 02:57:02.613143 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 55/98] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:01 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1321 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:02.805378 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-1974de9b-83c3-4513-a2e7-b30ec1aef2ff tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:02.807101 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-1974de9b-83c3-4513-a2e7-b30ec1aef2ff tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:02.815075 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1974de9b-83c3-4513-a2e7-b30ec1aef2ff tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:02.815881 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1974de9b-83c3-4513-a2e7-b30ec1aef2ff tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:02.816875 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1974de9b-83c3-4513-a2e7-b30ec1aef2ff tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:02.817464 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1974de9b-83c3-4513-a2e7-b30ec1aef2ff tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:02.867049 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-2fcc786e-d480-4c18-8343-4d836ca85595 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:02.867935 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-2fcc786e-d480-4c18-8343-4d836ca85595 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:02.876044 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2fcc786e-d480-4c18-8343-4d836ca85595 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:02.881251 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2fcc786e-d480-4c18-8343-4d836ca85595 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:02.882389 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2fcc786e-d480-4c18-8343-4d836ca85595 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:02.882965 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2fcc786e-d480-4c18-8343-4d836ca85595 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:03.514314 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-2fcc786e-d480-4c18-8343-4d836ca85595 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:03.531057 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-2fcc786e-d480-4c18-8343-4d836ca85595 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1318 microversion: 2.1 time: 0.667763 Feb 03 02:57:03.532308 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 56/99] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:02 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1318 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:03.537835 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-bcfe04f6-b756-4771-bc04-837dc85e6715 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:03.538444 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-bcfe04f6-b756-4771-bc04-837dc85e6715 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:03.556788 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-bcfe04f6-b756-4771-bc04-837dc85e6715 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:03.557444 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-bcfe04f6-b756-4771-bc04-837dc85e6715 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:03.558309 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-bcfe04f6-b756-4771-bc04-837dc85e6715 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:03.558952 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-bcfe04f6-b756-4771-bc04-837dc85e6715 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:03.591818 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-1974de9b-83c3-4513-a2e7-b30ec1aef2ff tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:03.605473 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-1974de9b-83c3-4513-a2e7-b30ec1aef2ff tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1314 microversion: 2.1 time: 0.808226 Feb 03 02:57:03.618990 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 44/100] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:02 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1314 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:03.646403 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-7d402792-7fc8-429b-a025-e3a12b16edab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:03.648676 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-7d402792-7fc8-429b-a025-e3a12b16edab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:03.656201 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7d402792-7fc8-429b-a025-e3a12b16edab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:03.656643 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7d402792-7fc8-429b-a025-e3a12b16edab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:03.658133 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7d402792-7fc8-429b-a025-e3a12b16edab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:03.658570 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7d402792-7fc8-429b-a025-e3a12b16edab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:03.936787 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-bcfe04f6-b756-4771-bc04-837dc85e6715 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:03.945240 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-bcfe04f6-b756-4771-bc04-837dc85e6715 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1364 microversion: 2.1 time: 0.411760 Feb 03 02:57:03.955155 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 57/101] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:03 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1364 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:04.001106 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-7d402792-7fc8-429b-a025-e3a12b16edab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:04.010077 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-7d402792-7fc8-429b-a025-e3a12b16edab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1321 microversion: 2.1 time: 0.377811 Feb 03 02:57:04.021224 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 45/102] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:03 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1321 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:04.292480 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-79d16d5e-7f02-4fdd-91f5-d85a3aa78e45 req-ce47d705-c145-4526-b8ba-50972c17631e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a00957e-c905-4466-8a03-befe71ab1e1c", "tag": "303c8ce3-0afd-4cac-878f-a7307e3741d0"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:57:04.294728 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:57:04.294728 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 02:57:04.318396 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-79d16d5e-7f02-4fdd-91f5-d85a3aa78e45 req-ce47d705-c145-4526-b8ba-50972c17631e service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:04.320290 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-79d16d5e-7f02-4fdd-91f5-d85a3aa78e45 req-ce47d705-c145-4526-b8ba-50972c17631e service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:04.355288 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-79d16d5e-7f02-4fdd-91f5-d85a3aa78e45 req-ce47d705-c145-4526-b8ba-50972c17631e service nova] Creating event network-changed:303c8ce3-0afd-4cac-878f-a7307e3741d0 for instance 9a00957e-c905-4466-8a03-befe71ab1e1c on hv-cinder-82758 Feb 03 02:57:04.355817 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-79d16d5e-7f02-4fdd-91f5-d85a3aa78e45 req-ce47d705-c145-4526-b8ba-50972c17631e service nova] Acquired lock "compute-rpcapi-router" {{(pid=116386) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 03 02:57:04.357014 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-84d24d59-84c7-42dc-98b6-779409623eb8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:04.357607 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-84d24d59-84c7-42dc-98b6-779409623eb8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:04.358596 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-84d24d59-84c7-42dc-98b6-779409623eb8 None None] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:04.359160 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-84d24d59-84c7-42dc-98b6-779409623eb8 None None] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:04.370378 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.compute.rpcapi [None req-84d24d59-84c7-42dc-98b6-779409623eb8 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Feb 03 02:57:04.371795 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-84d24d59-84c7-42dc-98b6-779409623eb8 None None] Releasing lock "compute-rpcapi-router" {{(pid=116386) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 03 02:57:04.399736 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-84d24d59-84c7-42dc-98b6-779409623eb8 None None] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110832 Feb 03 02:57:04.405334 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 58/103] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:57:04.551235 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-d55ce328-282e-420a-b4a0-25cdb7bb1084 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:04.552383 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-d55ce328-282e-420a-b4a0-25cdb7bb1084 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:04.564648 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d55ce328-282e-420a-b4a0-25cdb7bb1084 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:04.565337 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d55ce328-282e-420a-b4a0-25cdb7bb1084 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:04.566309 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d55ce328-282e-420a-b4a0-25cdb7bb1084 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:04.566905 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d55ce328-282e-420a-b4a0-25cdb7bb1084 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:04.625915 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-38accf9e-ef1b-413a-82f3-7025b1823009 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:04.627447 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-38accf9e-ef1b-413a-82f3-7025b1823009 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:04.652389 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-38accf9e-ef1b-413a-82f3-7025b1823009 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:04.652912 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-38accf9e-ef1b-413a-82f3-7025b1823009 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:04.656042 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-38accf9e-ef1b-413a-82f3-7025b1823009 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:04.656505 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-38accf9e-ef1b-413a-82f3-7025b1823009 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:04.823022 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-d55ce328-282e-420a-b4a0-25cdb7bb1084 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:04.830792 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-d55ce328-282e-420a-b4a0-25cdb7bb1084 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1318 microversion: 2.1 time: 0.286029 Feb 03 02:57:04.831647 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 46/104] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:04 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:04.926657 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-38accf9e-ef1b-413a-82f3-7025b1823009 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:04.934004 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-38accf9e-ef1b-413a-82f3-7025b1823009 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1314 microversion: 2.1 time: 0.313110 Feb 03 02:57:04.934582 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 59/105] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:04 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:04.962021 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-adb8b6e1-e7f1-4d14-ba00-e53aa287fae4 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:04.962947 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-adb8b6e1-e7f1-4d14-ba00-e53aa287fae4 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:04.969678 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-adb8b6e1-e7f1-4d14-ba00-e53aa287fae4 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:04.970178 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-adb8b6e1-e7f1-4d14-ba00-e53aa287fae4 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:04.971878 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-adb8b6e1-e7f1-4d14-ba00-e53aa287fae4 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:04.972534 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-adb8b6e1-e7f1-4d14-ba00-e53aa287fae4 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:05.029990 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-a8921b38-2917-40bd-941b-d073bef1ffe7 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:05.030969 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-a8921b38-2917-40bd-941b-d073bef1ffe7 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:05.039511 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a8921b38-2917-40bd-941b-d073bef1ffe7 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:05.039954 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a8921b38-2917-40bd-941b-d073bef1ffe7 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:05.041067 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a8921b38-2917-40bd-941b-d073bef1ffe7 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:05.042148 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a8921b38-2917-40bd-941b-d073bef1ffe7 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:05.159594 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-adb8b6e1-e7f1-4d14-ba00-e53aa287fae4 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:05.176338 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-adb8b6e1-e7f1-4d14-ba00-e53aa287fae4 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1364 microversion: 2.1 time: 0.216178 Feb 03 02:57:05.180475 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 47/106] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:04 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:05.245853 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-a8921b38-2917-40bd-941b-d073bef1ffe7 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:05.254261 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-a8921b38-2917-40bd-941b-d073bef1ffe7 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1321 microversion: 2.1 time: 0.230685 Feb 03 02:57:05.256518 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 60/107] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:05 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:05.849441 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-ba5a0d0e-c639-4418-b86f-fc2aeaac2875 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:05.850040 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-ba5a0d0e-c639-4418-b86f-fc2aeaac2875 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:05.857506 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ba5a0d0e-c639-4418-b86f-fc2aeaac2875 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:05.857940 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ba5a0d0e-c639-4418-b86f-fc2aeaac2875 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:05.858711 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ba5a0d0e-c639-4418-b86f-fc2aeaac2875 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:05.864524 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ba5a0d0e-c639-4418-b86f-fc2aeaac2875 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:05.954633 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-2a6b5029-f820-4283-9c9e-28d4154a9829 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:05.955837 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-2a6b5029-f820-4283-9c9e-28d4154a9829 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:05.962732 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2a6b5029-f820-4283-9c9e-28d4154a9829 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:05.963519 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2a6b5029-f820-4283-9c9e-28d4154a9829 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:05.964593 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2a6b5029-f820-4283-9c9e-28d4154a9829 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:05.965227 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2a6b5029-f820-4283-9c9e-28d4154a9829 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:06.221343 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-ba5a0d0e-c639-4418-b86f-fc2aeaac2875 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:06.233450 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-ba5a0d0e-c639-4418-b86f-fc2aeaac2875 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1318 microversion: 2.1 time: 0.389076 Feb 03 02:57:06.234213 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 48/108] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:05 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:06.248129 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-4f8a795e-8192-47a3-9e3c-f63c05c0fa96 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:06.248778 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-4f8a795e-8192-47a3-9e3c-f63c05c0fa96 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:06.265633 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4f8a795e-8192-47a3-9e3c-f63c05c0fa96 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:06.271023 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4f8a795e-8192-47a3-9e3c-f63c05c0fa96 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:06.273702 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4f8a795e-8192-47a3-9e3c-f63c05c0fa96 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:06.274381 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4f8a795e-8192-47a3-9e3c-f63c05c0fa96 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:06.409951 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-2a6b5029-f820-4283-9c9e-28d4154a9829 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:06.422959 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-2a6b5029-f820-4283-9c9e-28d4154a9829 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1314 microversion: 2.1 time: 0.474262 Feb 03 02:57:06.424646 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 61/109] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:05 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:06.432298 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-250e6f01-95ca-4872-a8f8-7d1eefc2eb04 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:06.432987 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-250e6f01-95ca-4872-a8f8-7d1eefc2eb04 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:06.441048 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-250e6f01-95ca-4872-a8f8-7d1eefc2eb04 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:06.441653 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-250e6f01-95ca-4872-a8f8-7d1eefc2eb04 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:06.456337 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-250e6f01-95ca-4872-a8f8-7d1eefc2eb04 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:06.456826 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-250e6f01-95ca-4872-a8f8-7d1eefc2eb04 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:06.577272 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-4f8a795e-8192-47a3-9e3c-f63c05c0fa96 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:06.585986 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-4f8a795e-8192-47a3-9e3c-f63c05c0fa96 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1364 microversion: 2.1 time: 0.341426 Feb 03 02:57:06.588741 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 49/110] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:06 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1364 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:06.676155 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-250e6f01-95ca-4872-a8f8-7d1eefc2eb04 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:06.683470 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-250e6f01-95ca-4872-a8f8-7d1eefc2eb04 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1321 microversion: 2.1 time: 0.257255 Feb 03 02:57:06.687258 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 62/111] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:06 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1321 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:07.251386 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-33e50212-a0f3-40d4-985f-a6c5c97ca9e1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:07.252152 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-33e50212-a0f3-40d4-985f-a6c5c97ca9e1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:07.259612 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-33e50212-a0f3-40d4-985f-a6c5c97ca9e1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:07.260270 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-33e50212-a0f3-40d4-985f-a6c5c97ca9e1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:07.261189 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-33e50212-a0f3-40d4-985f-a6c5c97ca9e1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:07.261798 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-33e50212-a0f3-40d4-985f-a6c5c97ca9e1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:07.427516 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-33e50212-a0f3-40d4-985f-a6c5c97ca9e1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:07.436812 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-33e50212-a0f3-40d4-985f-a6c5c97ca9e1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1318 microversion: 2.1 time: 0.189505 Feb 03 02:57:07.438388 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 50/112] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:07 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:07.440405 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-58c68433-e4f1-4f0c-b672-2cef7391dff4 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:07.441148 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-58c68433-e4f1-4f0c-b672-2cef7391dff4 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:07.450585 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-58c68433-e4f1-4f0c-b672-2cef7391dff4 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:07.451161 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-58c68433-e4f1-4f0c-b672-2cef7391dff4 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:07.452416 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-58c68433-e4f1-4f0c-b672-2cef7391dff4 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:07.453074 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-58c68433-e4f1-4f0c-b672-2cef7391dff4 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:07.605299 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-13d70d8b-7db5-4522-afd3-f707427f3a65 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:07.605927 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-13d70d8b-7db5-4522-afd3-f707427f3a65 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:07.606264 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-58c68433-e4f1-4f0c-b672-2cef7391dff4 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:07.613430 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-13d70d8b-7db5-4522-afd3-f707427f3a65 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:07.613873 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-13d70d8b-7db5-4522-afd3-f707427f3a65 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:07.613973 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-58c68433-e4f1-4f0c-b672-2cef7391dff4 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1314 microversion: 2.1 time: 0.178352 Feb 03 02:57:07.614466 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 63/113] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:07 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:07.614682 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-13d70d8b-7db5-4522-afd3-f707427f3a65 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:07.615075 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-13d70d8b-7db5-4522-afd3-f707427f3a65 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:07.702177 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-64b16565-2192-4b59-b24d-3ceabe33fbc4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:07.703091 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-64b16565-2192-4b59-b24d-3ceabe33fbc4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:07.710542 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-64b16565-2192-4b59-b24d-3ceabe33fbc4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:07.711431 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-64b16565-2192-4b59-b24d-3ceabe33fbc4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:07.712560 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-64b16565-2192-4b59-b24d-3ceabe33fbc4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:07.713084 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-64b16565-2192-4b59-b24d-3ceabe33fbc4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:07.761166 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-13d70d8b-7db5-4522-afd3-f707427f3a65 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:07.769775 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-13d70d8b-7db5-4522-afd3-f707427f3a65 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1364 microversion: 2.1 time: 0.168947 Feb 03 02:57:07.782223 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 51/114] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:07 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:07.903487 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-64b16565-2192-4b59-b24d-3ceabe33fbc4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:07.911128 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-64b16565-2192-4b59-b24d-3ceabe33fbc4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1321 microversion: 2.1 time: 0.212915 Feb 03 02:57:07.912790 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 64/115] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:07 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:08.454460 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-548f301b-95d9-4aed-a907-41ff67dbaf81 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:08.455000 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-548f301b-95d9-4aed-a907-41ff67dbaf81 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:08.461126 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-548f301b-95d9-4aed-a907-41ff67dbaf81 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:08.461576 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-548f301b-95d9-4aed-a907-41ff67dbaf81 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:08.462363 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-548f301b-95d9-4aed-a907-41ff67dbaf81 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:08.462791 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-548f301b-95d9-4aed-a907-41ff67dbaf81 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:08.603261 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-548f301b-95d9-4aed-a907-41ff67dbaf81 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:08.614592 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-548f301b-95d9-4aed-a907-41ff67dbaf81 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1318 microversion: 2.1 time: 0.163689 Feb 03 02:57:08.615534 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 52/116] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:08 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:08.630564 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-dd4b9f54-ea2a-42cb-bba0-572564bc4913 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:08.631196 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-dd4b9f54-ea2a-42cb-bba0-572564bc4913 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:08.637139 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-dd4b9f54-ea2a-42cb-bba0-572564bc4913 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:08.637587 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-dd4b9f54-ea2a-42cb-bba0-572564bc4913 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:08.638364 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-dd4b9f54-ea2a-42cb-bba0-572564bc4913 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:08.638791 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-dd4b9f54-ea2a-42cb-bba0-572564bc4913 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:08.783906 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-dd4b9f54-ea2a-42cb-bba0-572564bc4913 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:08.790992 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-b41edae1-3f4f-4df3-969d-f0f72f5bc3ed tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:08.791700 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-dd4b9f54-ea2a-42cb-bba0-572564bc4913 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1314 microversion: 2.1 time: 0.164707 Feb 03 02:57:08.792011 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-b41edae1-3f4f-4df3-969d-f0f72f5bc3ed tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:08.798190 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 65/117] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:08 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:08.798287 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b41edae1-3f4f-4df3-969d-f0f72f5bc3ed tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:08.798373 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b41edae1-3f4f-4df3-969d-f0f72f5bc3ed tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:08.799198 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b41edae1-3f4f-4df3-969d-f0f72f5bc3ed tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:08.799781 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b41edae1-3f4f-4df3-969d-f0f72f5bc3ed tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:08.929466 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-3bee6e38-304e-4b56-97c6-c1e685b08792 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:08.930281 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-3bee6e38-304e-4b56-97c6-c1e685b08792 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:08.941259 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-b41edae1-3f4f-4df3-969d-f0f72f5bc3ed tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:08.946555 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3bee6e38-304e-4b56-97c6-c1e685b08792 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:08.947597 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3bee6e38-304e-4b56-97c6-c1e685b08792 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:08.950096 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-b41edae1-3f4f-4df3-969d-f0f72f5bc3ed tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1364 microversion: 2.1 time: 0.162686 Feb 03 02:57:08.951123 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3bee6e38-304e-4b56-97c6-c1e685b08792 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:08.951562 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3bee6e38-304e-4b56-97c6-c1e685b08792 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:08.956501 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 53/118] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:08 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:09.143100 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-3bee6e38-304e-4b56-97c6-c1e685b08792 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:09.154271 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-3bee6e38-304e-4b56-97c6-c1e685b08792 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1321 microversion: 2.1 time: 0.229313 Feb 03 02:57:09.154942 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 66/119] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:08 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:09.638323 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-be709589-55fb-4e57-ad05-2b97f567f865 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:09.639521 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-be709589-55fb-4e57-ad05-2b97f567f865 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:09.647274 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-be709589-55fb-4e57-ad05-2b97f567f865 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:09.648597 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-be709589-55fb-4e57-ad05-2b97f567f865 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:09.649649 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-be709589-55fb-4e57-ad05-2b97f567f865 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:09.650289 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-be709589-55fb-4e57-ad05-2b97f567f865 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:09.816477 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-0a66ebd9-0984-4dc9-b48d-19183265a415 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:09.818366 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-0a66ebd9-0984-4dc9-b48d-19183265a415 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:09.825562 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0a66ebd9-0984-4dc9-b48d-19183265a415 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:09.826204 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0a66ebd9-0984-4dc9-b48d-19183265a415 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:09.827041 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0a66ebd9-0984-4dc9-b48d-19183265a415 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:09.827615 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0a66ebd9-0984-4dc9-b48d-19183265a415 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:09.878795 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-be709589-55fb-4e57-ad05-2b97f567f865 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:09.889315 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-be709589-55fb-4e57-ad05-2b97f567f865 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1318 microversion: 2.1 time: 0.254967 Feb 03 02:57:09.899052 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 54/120] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:09 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:09.975243 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-4d6b9d18-94aa-4a54-94a1-860619f59d3e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:09.976066 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-4d6b9d18-94aa-4a54-94a1-860619f59d3e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:09.988010 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4d6b9d18-94aa-4a54-94a1-860619f59d3e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:09.990171 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4d6b9d18-94aa-4a54-94a1-860619f59d3e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:09.991021 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4d6b9d18-94aa-4a54-94a1-860619f59d3e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:09.991511 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4d6b9d18-94aa-4a54-94a1-860619f59d3e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:10.098973 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-0a66ebd9-0984-4dc9-b48d-19183265a415 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:10.114193 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-0a66ebd9-0984-4dc9-b48d-19183265a415 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1314 microversion: 2.1 time: 0.308130 Feb 03 02:57:10.115176 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 67/121] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:09 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:10.172539 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-6fe2a83c-d4eb-4ab3-8f2c-9982c8d7f044 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:10.173244 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-6fe2a83c-d4eb-4ab3-8f2c-9982c8d7f044 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:10.186134 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6fe2a83c-d4eb-4ab3-8f2c-9982c8d7f044 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:10.188434 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6fe2a83c-d4eb-4ab3-8f2c-9982c8d7f044 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:10.190997 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6fe2a83c-d4eb-4ab3-8f2c-9982c8d7f044 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:10.191530 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6fe2a83c-d4eb-4ab3-8f2c-9982c8d7f044 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:10.220259 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-4d6b9d18-94aa-4a54-94a1-860619f59d3e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:10.228992 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-4d6b9d18-94aa-4a54-94a1-860619f59d3e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1364 microversion: 2.1 time: 0.259763 Feb 03 02:57:10.241419 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 55/122] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:09 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1364 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:10.378177 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-6fe2a83c-d4eb-4ab3-8f2c-9982c8d7f044 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:10.389933 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-6fe2a83c-d4eb-4ab3-8f2c-9982c8d7f044 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1321 microversion: 2.1 time: 0.222557 Feb 03 02:57:10.390783 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 68/123] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:10 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:10.909377 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-554e5e61-e0a5-4851-87e7-4401545d99c4 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:10.909929 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-554e5e61-e0a5-4851-87e7-4401545d99c4 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:10.916116 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-554e5e61-e0a5-4851-87e7-4401545d99c4 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:10.916560 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-554e5e61-e0a5-4851-87e7-4401545d99c4 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:10.917357 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-554e5e61-e0a5-4851-87e7-4401545d99c4 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:10.917785 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-554e5e61-e0a5-4851-87e7-4401545d99c4 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:11.056509 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-554e5e61-e0a5-4851-87e7-4401545d99c4 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:11.063908 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-554e5e61-e0a5-4851-87e7-4401545d99c4 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1318 microversion: 2.1 time: 0.159636 Feb 03 02:57:11.064471 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 56/124] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:10 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:11.131649 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-436e4bf1-16dd-44dd-887a-3b31c02dee8c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:11.132227 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-436e4bf1-16dd-44dd-887a-3b31c02dee8c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:11.138430 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-436e4bf1-16dd-44dd-887a-3b31c02dee8c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:11.138871 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-436e4bf1-16dd-44dd-887a-3b31c02dee8c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:11.139669 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-436e4bf1-16dd-44dd-887a-3b31c02dee8c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:11.140167 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-436e4bf1-16dd-44dd-887a-3b31c02dee8c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:11.260840 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-1ff18e0b-527a-4bbd-b3a0-61c4984a21f9 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:11.262399 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-1ff18e0b-527a-4bbd-b3a0-61c4984a21f9 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:11.268347 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1ff18e0b-527a-4bbd-b3a0-61c4984a21f9 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:11.269109 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1ff18e0b-527a-4bbd-b3a0-61c4984a21f9 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:11.269883 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1ff18e0b-527a-4bbd-b3a0-61c4984a21f9 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:11.270307 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1ff18e0b-527a-4bbd-b3a0-61c4984a21f9 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:11.276089 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-436e4bf1-16dd-44dd-887a-3b31c02dee8c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:11.283776 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-436e4bf1-16dd-44dd-887a-3b31c02dee8c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1314 microversion: 2.1 time: 0.156168 Feb 03 02:57:11.284301 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 69/125] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:11 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:11.403145 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-1ff18e0b-527a-4bbd-b3a0-61c4984a21f9 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:11.406109 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-8a16b86d-7db2-4ee1-b187-42a34ea6318c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:11.407380 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-8a16b86d-7db2-4ee1-b187-42a34ea6318c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:11.411272 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-1ff18e0b-527a-4bbd-b3a0-61c4984a21f9 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1364 microversion: 2.1 time: 0.154219 Feb 03 02:57:11.420850 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8a16b86d-7db2-4ee1-b187-42a34ea6318c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:11.420850 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8a16b86d-7db2-4ee1-b187-42a34ea6318c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:11.420850 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8a16b86d-7db2-4ee1-b187-42a34ea6318c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:11.420850 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8a16b86d-7db2-4ee1-b187-42a34ea6318c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:11.422317 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 57/126] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:11 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:11.557945 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-8a16b86d-7db2-4ee1-b187-42a34ea6318c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:11.565366 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-8a16b86d-7db2-4ee1-b187-42a34ea6318c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1321 microversion: 2.1 time: 0.163036 Feb 03 02:57:11.565943 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 70/127] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:11 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:12.084805 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-08dc4f53-9197-4983-85b8-5c7a4604fd63 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:12.085920 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-08dc4f53-9197-4983-85b8-5c7a4604fd63 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:12.095696 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-08dc4f53-9197-4983-85b8-5c7a4604fd63 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:12.096138 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-08dc4f53-9197-4983-85b8-5c7a4604fd63 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:12.096959 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-08dc4f53-9197-4983-85b8-5c7a4604fd63 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:12.097386 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-08dc4f53-9197-4983-85b8-5c7a4604fd63 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:12.240308 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-08dc4f53-9197-4983-85b8-5c7a4604fd63 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:12.247803 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-08dc4f53-9197-4983-85b8-5c7a4604fd63 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1318 microversion: 2.1 time: 0.169242 Feb 03 02:57:12.248369 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 58/128] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:12 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:12.301096 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-b759a835-2673-4330-8b72-fc80c4198b0d tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:12.301698 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-b759a835-2673-4330-8b72-fc80c4198b0d tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:12.308115 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b759a835-2673-4330-8b72-fc80c4198b0d tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:12.308562 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b759a835-2673-4330-8b72-fc80c4198b0d tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:12.309373 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b759a835-2673-4330-8b72-fc80c4198b0d tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:12.309830 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b759a835-2673-4330-8b72-fc80c4198b0d tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:12.429094 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-c5967601-d7ad-4e6e-86c6-f5f34d75a981 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:12.429709 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-c5967601-d7ad-4e6e-86c6-f5f34d75a981 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:12.439913 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c5967601-d7ad-4e6e-86c6-f5f34d75a981 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:12.441189 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c5967601-d7ad-4e6e-86c6-f5f34d75a981 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:12.442506 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c5967601-d7ad-4e6e-86c6-f5f34d75a981 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:12.443479 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c5967601-d7ad-4e6e-86c6-f5f34d75a981 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:12.670703 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-b759a835-2673-4330-8b72-fc80c4198b0d tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:12.678092 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-b759a835-2673-4330-8b72-fc80c4198b0d tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1314 microversion: 2.1 time: 0.380706 Feb 03 02:57:12.678660 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 71/129] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:12 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:12.688578 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-2a56026c-fc16-4246-b631-9d77d3875e02 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:12.689212 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-2a56026c-fc16-4246-b631-9d77d3875e02 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:12.694922 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2a56026c-fc16-4246-b631-9d77d3875e02 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:12.695482 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2a56026c-fc16-4246-b631-9d77d3875e02 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:12.696363 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2a56026c-fc16-4246-b631-9d77d3875e02 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:12.696828 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2a56026c-fc16-4246-b631-9d77d3875e02 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:12.743020 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-c5967601-d7ad-4e6e-86c6-f5f34d75a981 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:12.750304 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-c5967601-d7ad-4e6e-86c6-f5f34d75a981 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1364 microversion: 2.1 time: 0.326355 Feb 03 02:57:12.751101 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 59/130] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:12 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1364 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:12.835911 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-2a56026c-fc16-4246-b631-9d77d3875e02 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:12.843785 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-2a56026c-fc16-4246-b631-9d77d3875e02 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1321 microversion: 2.1 time: 0.163769 Feb 03 02:57:12.844347 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 72/131] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:12 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:13.269497 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-5d1ed884-264a-42bf-a72f-e65387c431f5 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:13.270397 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-5d1ed884-264a-42bf-a72f-e65387c431f5 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:13.278898 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5d1ed884-264a-42bf-a72f-e65387c431f5 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:13.279444 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5d1ed884-264a-42bf-a72f-e65387c431f5 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:13.280330 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5d1ed884-264a-42bf-a72f-e65387c431f5 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:13.280782 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5d1ed884-264a-42bf-a72f-e65387c431f5 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:13.413290 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-5d1ed884-264a-42bf-a72f-e65387c431f5 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:13.420742 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-5d1ed884-264a-42bf-a72f-e65387c431f5 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1318 microversion: 2.1 time: 0.157196 Feb 03 02:57:13.421304 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 60/132] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:13 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:13.695114 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-ff3c08ee-0a7a-4cc6-85a0-dad9b29333ef tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:13.696398 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-ff3c08ee-0a7a-4cc6-85a0-dad9b29333ef tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:13.705177 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ff3c08ee-0a7a-4cc6-85a0-dad9b29333ef tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:13.705614 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ff3c08ee-0a7a-4cc6-85a0-dad9b29333ef tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:13.706467 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ff3c08ee-0a7a-4cc6-85a0-dad9b29333ef tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:13.708774 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ff3c08ee-0a7a-4cc6-85a0-dad9b29333ef tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:13.768558 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-048e52e3-4234-4d3d-8528-facfe20f8e9a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:13.769175 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-048e52e3-4234-4d3d-8528-facfe20f8e9a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:13.779315 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-048e52e3-4234-4d3d-8528-facfe20f8e9a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:13.781328 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-048e52e3-4234-4d3d-8528-facfe20f8e9a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:13.782356 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-048e52e3-4234-4d3d-8528-facfe20f8e9a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:13.782944 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-048e52e3-4234-4d3d-8528-facfe20f8e9a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:14.017114 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-ff3c08ee-0a7a-4cc6-85a0-dad9b29333ef tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:14.025738 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-ff3c08ee-0a7a-4cc6-85a0-dad9b29333ef tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1314 microversion: 2.1 time: 0.334832 Feb 03 02:57:14.027649 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 73/133] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:13 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:14.115096 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-048e52e3-4234-4d3d-8528-facfe20f8e9a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:14.126711 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-048e52e3-4234-4d3d-8528-facfe20f8e9a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1364 microversion: 2.1 time: 0.362913 Feb 03 02:57:14.136880 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 61/134] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:13 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1364 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:14.150042 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-d76f2f01-8ee0-41b8-b0f4-b897d1ac769e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:14.150677 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-d76f2f01-8ee0-41b8-b0f4-b897d1ac769e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:14.157008 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d76f2f01-8ee0-41b8-b0f4-b897d1ac769e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:14.157525 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d76f2f01-8ee0-41b8-b0f4-b897d1ac769e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:14.158473 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d76f2f01-8ee0-41b8-b0f4-b897d1ac769e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:14.159132 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d76f2f01-8ee0-41b8-b0f4-b897d1ac769e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:14.264323 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-bd2aadfd-cbe5-43bf-bab0-25d8edddfe5c req-0a5b7ca5-f840-47a1-9a86-47c3926764f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933b2272-897b-43bc-8ba0-252edeef0170", "name": "network-vif-plugged", "status": "completed", "tag": "44de70aa-dd5c-4b82-94f1-25e286c3f42f"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:57:14.267001 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:57:14.267001 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 02:57:14.276651 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-bd2aadfd-cbe5-43bf-bab0-25d8edddfe5c req-0a5b7ca5-f840-47a1-9a86-47c3926764f1 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:14.277639 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-bd2aadfd-cbe5-43bf-bab0-25d8edddfe5c req-0a5b7ca5-f840-47a1-9a86-47c3926764f1 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:14.290773 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-bd2aadfd-cbe5-43bf-bab0-25d8edddfe5c req-0a5b7ca5-f840-47a1-9a86-47c3926764f1 service nova] Creating event network-vif-plugged:44de70aa-dd5c-4b82-94f1-25e286c3f42f for instance 933b2272-897b-43bc-8ba0-252edeef0170 on hv-cinder-82758 Feb 03 02:57:14.298206 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-bd2aadfd-cbe5-43bf-bab0-25d8edddfe5c req-0a5b7ca5-f840-47a1-9a86-47c3926764f1 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.269103 Feb 03 02:57:14.304529 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 74/135] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:57:14.399819 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-d76f2f01-8ee0-41b8-b0f4-b897d1ac769e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:14.408553 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-d76f2f01-8ee0-41b8-b0f4-b897d1ac769e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1321 microversion: 2.1 time: 0.265393 Feb 03 02:57:14.409296 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 62/136] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:14 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:14.438641 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-3fcac0f6-6e82-46db-ad77-a0a77b5825f2 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:14.439387 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-3fcac0f6-6e82-46db-ad77-a0a77b5825f2 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:14.445604 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3fcac0f6-6e82-46db-ad77-a0a77b5825f2 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:14.446263 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3fcac0f6-6e82-46db-ad77-a0a77b5825f2 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:14.447069 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3fcac0f6-6e82-46db-ad77-a0a77b5825f2 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:14.447504 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3fcac0f6-6e82-46db-ad77-a0a77b5825f2 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:14.603419 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-3fcac0f6-6e82-46db-ad77-a0a77b5825f2 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:14.614603 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-3fcac0f6-6e82-46db-ad77-a0a77b5825f2 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1318 microversion: 2.1 time: 0.180356 Feb 03 02:57:14.615220 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 75/137] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:14 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:15.043574 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-fcfd4f2d-543a-4563-9f24-8107a9444e5e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:15.044079 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-fcfd4f2d-543a-4563-9f24-8107a9444e5e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:15.050055 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fcfd4f2d-543a-4563-9f24-8107a9444e5e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:15.050500 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fcfd4f2d-543a-4563-9f24-8107a9444e5e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:15.051273 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fcfd4f2d-543a-4563-9f24-8107a9444e5e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:15.051705 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fcfd4f2d-543a-4563-9f24-8107a9444e5e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:15.143943 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-93b2b52f-cb23-4cbd-9af7-48ac71dc3868 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:15.145208 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-93b2b52f-cb23-4cbd-9af7-48ac71dc3868 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:15.152319 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-93b2b52f-cb23-4cbd-9af7-48ac71dc3868 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:15.152765 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-93b2b52f-cb23-4cbd-9af7-48ac71dc3868 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:15.153561 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-93b2b52f-cb23-4cbd-9af7-48ac71dc3868 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:15.154013 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-93b2b52f-cb23-4cbd-9af7-48ac71dc3868 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:15.231476 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-fcfd4f2d-543a-4563-9f24-8107a9444e5e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:15.239429 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-fcfd4f2d-543a-4563-9f24-8107a9444e5e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1314 microversion: 2.1 time: 0.199579 Feb 03 02:57:15.240559 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 63/138] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:15 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:15.322190 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-93b2b52f-cb23-4cbd-9af7-48ac71dc3868 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:15.332315 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-93b2b52f-cb23-4cbd-9af7-48ac71dc3868 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1364 microversion: 2.1 time: 0.192015 Feb 03 02:57:15.333439 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 76/139] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:15 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:15.427409 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-235841a7-0106-4ff2-8710-56ae983083f5 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:15.428155 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-235841a7-0106-4ff2-8710-56ae983083f5 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:15.434800 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-235841a7-0106-4ff2-8710-56ae983083f5 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:15.435363 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-235841a7-0106-4ff2-8710-56ae983083f5 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:15.436263 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-235841a7-0106-4ff2-8710-56ae983083f5 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:15.436833 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-235841a7-0106-4ff2-8710-56ae983083f5 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:15.579407 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-235841a7-0106-4ff2-8710-56ae983083f5 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:15.588656 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-235841a7-0106-4ff2-8710-56ae983083f5 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1321 microversion: 2.1 time: 0.165026 Feb 03 02:57:15.597195 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 64/140] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:15 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:15.633191 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-0563cdfc-5ed0-47f3-a72e-41690c40ba44 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:15.633928 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-0563cdfc-5ed0-47f3-a72e-41690c40ba44 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:15.640372 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0563cdfc-5ed0-47f3-a72e-41690c40ba44 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:15.645471 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0563cdfc-5ed0-47f3-a72e-41690c40ba44 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:15.646473 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0563cdfc-5ed0-47f3-a72e-41690c40ba44 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:15.647033 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0563cdfc-5ed0-47f3-a72e-41690c40ba44 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:15.786813 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-0563cdfc-5ed0-47f3-a72e-41690c40ba44 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:15.794670 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-0563cdfc-5ed0-47f3-a72e-41690c40ba44 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1318 microversion: 2.1 time: 0.166943 Feb 03 02:57:15.795229 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 77/141] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:15 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:16.257605 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-c722af1a-a9c2-446f-8fc9-a22f786b6e5a tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:16.258689 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-c722af1a-a9c2-446f-8fc9-a22f786b6e5a tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:16.264707 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c722af1a-a9c2-446f-8fc9-a22f786b6e5a tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:16.265355 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c722af1a-a9c2-446f-8fc9-a22f786b6e5a tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:16.266265 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c722af1a-a9c2-446f-8fc9-a22f786b6e5a tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:16.266830 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c722af1a-a9c2-446f-8fc9-a22f786b6e5a tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:16.314624 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-24d28310-9d8a-41e2-941d-5ce36cf2bd20 req-07e55376-1b90-45a9-aaec-7f8089d5f919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2abf9364-36a9-416e-831f-00f7508465bd", "name": "network-vif-plugged", "status": "completed", "tag": "56bc6508-b90c-4a56-92a7-ede9dab41a4f"}, {"server_uuid": "34add2e5-8d7d-42c6-8f4c-e7a60fb27183", "name": "network-vif-plugged", "status": "completed", "tag": "4f976c37-c124-473b-94e5-f47a2ad3d40b"}, {"server_uuid": "01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e", "name": "network-vif-plugged", "status": "completed", "tag": "514f132e-1831-4333-8bbe-abcdacde0949"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:57:16.316545 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:57:16.316545 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 02:57:16.325706 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-24d28310-9d8a-41e2-941d-5ce36cf2bd20 req-07e55376-1b90-45a9-aaec-7f8089d5f919 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:16.326139 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-24d28310-9d8a-41e2-941d-5ce36cf2bd20 req-07e55376-1b90-45a9-aaec-7f8089d5f919 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:16.342269 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-24d28310-9d8a-41e2-941d-5ce36cf2bd20 req-07e55376-1b90-45a9-aaec-7f8089d5f919 service nova] Creating event network-vif-plugged:56bc6508-b90c-4a56-92a7-ede9dab41a4f for instance 2abf9364-36a9-416e-831f-00f7508465bd on hv-cinder-82758 Feb 03 02:57:16.343699 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-24d28310-9d8a-41e2-941d-5ce36cf2bd20 req-07e55376-1b90-45a9-aaec-7f8089d5f919 service nova] Creating event network-vif-plugged:4f976c37-c124-473b-94e5-f47a2ad3d40b for instance 34add2e5-8d7d-42c6-8f4c-e7a60fb27183 on hv-cinder-82758 Feb 03 02:57:16.344677 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-24d28310-9d8a-41e2-941d-5ce36cf2bd20 req-07e55376-1b90-45a9-aaec-7f8089d5f919 service nova] Creating event network-vif-plugged:514f132e-1831-4333-8bbe-abcdacde0949 for instance 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e on hv-cinder-82758 Feb 03 02:57:16.354645 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-24d28310-9d8a-41e2-941d-5ce36cf2bd20 req-07e55376-1b90-45a9-aaec-7f8089d5f919 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.043809 Feb 03 02:57:16.355590 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 78/142] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 03 02:57:16.363105 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-b49ca77e-44c9-443e-add1-5dd1550b7a02 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:16.363910 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-b49ca77e-44c9-443e-add1-5dd1550b7a02 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:16.371043 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b49ca77e-44c9-443e-add1-5dd1550b7a02 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:16.371482 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b49ca77e-44c9-443e-add1-5dd1550b7a02 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:16.372262 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b49ca77e-44c9-443e-add1-5dd1550b7a02 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:16.372689 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b49ca77e-44c9-443e-add1-5dd1550b7a02 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:16.420710 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-c722af1a-a9c2-446f-8fc9-a22f786b6e5a tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:16.439075 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-c722af1a-a9c2-446f-8fc9-a22f786b6e5a tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1314 microversion: 2.1 time: 0.185536 Feb 03 02:57:16.448315 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 65/143] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:16 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:16.552423 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-b49ca77e-44c9-443e-add1-5dd1550b7a02 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:16.560252 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-b49ca77e-44c9-443e-add1-5dd1550b7a02 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1364 microversion: 2.1 time: 0.202610 Feb 03 02:57:16.562588 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 79/144] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:16 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1364 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:16.607446 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-8221b2ba-d0d6-4892-9e0d-417331950fb3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:16.608051 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-8221b2ba-d0d6-4892-9e0d-417331950fb3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:16.614141 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8221b2ba-d0d6-4892-9e0d-417331950fb3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:16.614700 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8221b2ba-d0d6-4892-9e0d-417331950fb3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:16.615695 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8221b2ba-d0d6-4892-9e0d-417331950fb3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:16.616233 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8221b2ba-d0d6-4892-9e0d-417331950fb3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:16.810919 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-4325b865-e6cf-4d88-8cb8-e4f43ac6dd0d tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:16.811556 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-4325b865-e6cf-4d88-8cb8-e4f43ac6dd0d tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:16.817876 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4325b865-e6cf-4d88-8cb8-e4f43ac6dd0d tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:16.818293 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4325b865-e6cf-4d88-8cb8-e4f43ac6dd0d tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:16.819071 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4325b865-e6cf-4d88-8cb8-e4f43ac6dd0d tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:16.819505 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4325b865-e6cf-4d88-8cb8-e4f43ac6dd0d tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:16.872852 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-8221b2ba-d0d6-4892-9e0d-417331950fb3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:16.880565 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-8221b2ba-d0d6-4892-9e0d-417331950fb3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1321 microversion: 2.1 time: 0.277133 Feb 03 02:57:16.881258 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 66/145] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:16 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:16.996764 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-4325b865-e6cf-4d88-8cb8-e4f43ac6dd0d tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:17.004402 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-4325b865-e6cf-4d88-8cb8-e4f43ac6dd0d tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1318 microversion: 2.1 time: 0.197305 Feb 03 02:57:17.014230 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 80/146] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:16 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:17.462253 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-45696c88-3088-4529-b20b-63fd32c377d0 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:17.462919 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-45696c88-3088-4529-b20b-63fd32c377d0 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:17.475202 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-45696c88-3088-4529-b20b-63fd32c377d0 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:17.476395 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-45696c88-3088-4529-b20b-63fd32c377d0 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:17.478405 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-45696c88-3088-4529-b20b-63fd32c377d0 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:17.481144 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-45696c88-3088-4529-b20b-63fd32c377d0 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:17.579210 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-ed04cc56-890b-40d3-88f0-37aa7609291a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:17.580446 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-ed04cc56-890b-40d3-88f0-37aa7609291a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:17.591326 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ed04cc56-890b-40d3-88f0-37aa7609291a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:17.592093 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ed04cc56-890b-40d3-88f0-37aa7609291a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:17.593194 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ed04cc56-890b-40d3-88f0-37aa7609291a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:17.593833 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ed04cc56-890b-40d3-88f0-37aa7609291a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:17.835223 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-45696c88-3088-4529-b20b-63fd32c377d0 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:17.843918 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-45696c88-3088-4529-b20b-63fd32c377d0 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1314 microversion: 2.1 time: 0.385902 Feb 03 02:57:17.844772 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 67/147] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:17 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:17.892178 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-ed04cc56-890b-40d3-88f0-37aa7609291a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:17.900631 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-1024b3e7-3136-47a7-a1f4-a1afee85ceb1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:17.901586 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-1024b3e7-3136-47a7-a1f4-a1afee85ceb1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:17.906342 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-ed04cc56-890b-40d3-88f0-37aa7609291a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1364 microversion: 2.1 time: 0.331242 Feb 03 02:57:17.907310 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 81/148] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:17 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1364 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:17.908154 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1024b3e7-3136-47a7-a1f4-a1afee85ceb1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:17.908629 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1024b3e7-3136-47a7-a1f4-a1afee85ceb1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:17.909471 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1024b3e7-3136-47a7-a1f4-a1afee85ceb1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:17.909974 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1024b3e7-3136-47a7-a1f4-a1afee85ceb1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:18.021269 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-754b3a6d-0723-4973-9635-570ab12f154f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:18.021999 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-754b3a6d-0723-4973-9635-570ab12f154f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:18.028793 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-754b3a6d-0723-4973-9635-570ab12f154f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:18.029285 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-754b3a6d-0723-4973-9635-570ab12f154f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:18.030310 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-754b3a6d-0723-4973-9635-570ab12f154f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:18.030861 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-754b3a6d-0723-4973-9635-570ab12f154f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:18.062257 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-1024b3e7-3136-47a7-a1f4-a1afee85ceb1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:18.073524 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-1024b3e7-3136-47a7-a1f4-a1afee85ceb1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1321 microversion: 2.1 time: 0.176731 Feb 03 02:57:18.074668 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 68/149] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:17 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:18.184887 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-754b3a6d-0723-4973-9635-570ab12f154f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:18.193073 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-754b3a6d-0723-4973-9635-570ab12f154f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1318 microversion: 2.1 time: 0.175391 Feb 03 02:57:18.193772 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 82/150] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:18 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:18.639210 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-9ec4658a-c56e-40ac-97fa-892ecffcab56 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-850144957", "imageRef": "99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce", "flavorRef": "452", "networks": [{"uuid": "22fe169f-e273-4ced-9b97-e4e9b084e012"}]}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:57:18.690929 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.network.neutron [None req-9ec4658a-c56e-40ac-97fa-892ecffcab56 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] validate_networks() for [('22fe169f-e273-4ced-9b97-e4e9b084e012', None, None, None, None, None)] {{(pid=116385) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 03 02:57:18.860884 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-a4274084-fac8-4b69-b401-581ecc7eec24 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:18.861520 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-a4274084-fac8-4b69-b401-581ecc7eec24 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:18.867492 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a4274084-fac8-4b69-b401-581ecc7eec24 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:18.867936 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a4274084-fac8-4b69-b401-581ecc7eec24 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:18.868736 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a4274084-fac8-4b69-b401-581ecc7eec24 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:18.869145 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a4274084-fac8-4b69-b401-581ecc7eec24 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:19.076167 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-a4274084-fac8-4b69-b401-581ecc7eec24 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:19.090611 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-a4274084-fac8-4b69-b401-581ecc7eec24 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1314 microversion: 2.1 time: 0.233222 Feb 03 02:57:19.091497 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 83/151] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:18 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:19.099372 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-9ec4658a-c56e-40ac-97fa-892ecffcab56 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Flavor limits 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 03 02:57:19.099794 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-9ec4658a-c56e-40ac-97fa-892ecffcab56 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Image limits 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 03 02:57:19.100519 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-9ec4658a-c56e-40ac-97fa-892ecffcab56 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Flavor pref 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 03 02:57:19.101089 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-9ec4658a-c56e-40ac-97fa-892ecffcab56 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Image pref 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 03 02:57:19.101497 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-9ec4658a-c56e-40ac-97fa-892ecffcab56 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 03 02:57:19.105070 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-75f912f9-5ef1-497e-9078-705648dd0edd tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:19.105857 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-75f912f9-5ef1-497e-9078-705648dd0edd tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:19.111767 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9ec4658a-c56e-40ac-97fa-892ecffcab56 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:19.112200 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9ec4658a-c56e-40ac-97fa-892ecffcab56 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:19.112796 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-75f912f9-5ef1-497e-9078-705648dd0edd tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:19.113011 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9ec4658a-c56e-40ac-97fa-892ecffcab56 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:19.113436 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9ec4658a-c56e-40ac-97fa-892ecffcab56 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:19.113742 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-75f912f9-5ef1-497e-9078-705648dd0edd tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:19.114829 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-75f912f9-5ef1-497e-9078-705648dd0edd tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:19.115415 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-75f912f9-5ef1-497e-9078-705648dd0edd tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:19.130100 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-9ec4658a-c56e-40ac-97fa-892ecffcab56 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Getting quotas for project 15c4256dc55e466d95808fa66f72c37d. Resources: {'cores', 'ram', 'instances'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 02:57:19.133873 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-9ec4658a-c56e-40ac-97fa-892ecffcab56 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Getting quotas for user 3754bf46af13470faf170277d5086e88 and project 15c4256dc55e466d95808fa66f72c37d. Resources: {'cores', 'ram', 'instances'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 02:57:19.146704 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-9ec4658a-c56e-40ac-97fa-892ecffcab56 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Going to run 1 instances... {{(pid=116385) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 03 02:57:19.149036 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-9ec4658a-c56e-40ac-97fa-892ecffcab56 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 03 02:57:19.200488 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-9ec4658a-c56e-40ac-97fa-892ecffcab56 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564971 Feb 03 02:57:19.204886 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 69/152] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Feb 3 02:57:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 03 02:57:19.209644 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-df631881-2891-4a44-839e-cb3cb8384db4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:19.210706 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-df631881-2891-4a44-839e-cb3cb8384db4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:19.216988 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-df631881-2891-4a44-839e-cb3cb8384db4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:19.217631 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-df631881-2891-4a44-839e-cb3cb8384db4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:19.218562 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-df631881-2891-4a44-839e-cb3cb8384db4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:19.219173 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-df631881-2891-4a44-839e-cb3cb8384db4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:19.260780 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-75f912f9-5ef1-497e-9078-705648dd0edd tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:19.269302 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-75f912f9-5ef1-497e-9078-705648dd0edd tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1364 microversion: 2.1 time: 0.176249 Feb 03 02:57:19.270203 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 84/153] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:19 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:19.274905 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-ad56fdb8-2011-46af-93ef-0a461cf9789e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:19.275725 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-ad56fdb8-2011-46af-93ef-0a461cf9789e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:19.282359 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ad56fdb8-2011-46af-93ef-0a461cf9789e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:19.283120 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ad56fdb8-2011-46af-93ef-0a461cf9789e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:19.284203 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ad56fdb8-2011-46af-93ef-0a461cf9789e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:19.284782 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ad56fdb8-2011-46af-93ef-0a461cf9789e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:19.428521 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-df631881-2891-4a44-839e-cb3cb8384db4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:19.439960 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-df631881-2891-4a44-839e-cb3cb8384db4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1321 microversion: 2.1 time: 0.233109 Feb 03 02:57:19.441813 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 70/154] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:19 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:19.448668 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-c3b11eb6-af40-488c-a0f2-67fa463d194b tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:19.450131 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-c3b11eb6-af40-488c-a0f2-67fa463d194b tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:19.529125 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-c3b11eb6-af40-488c-a0f2-67fa463d194b tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:19.536417 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-c3b11eb6-af40-488c-a0f2-67fa463d194b tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c" status: 200 len: 1213 microversion: 2.1 time: 0.093407 Feb 03 02:57:19.537080 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 71/155] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:19 2022] GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c => generated 1213 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:19.539361 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-ad56fdb8-2011-46af-93ef-0a461cf9789e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:19.547530 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-ad56fdb8-2011-46af-93ef-0a461cf9789e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1318 microversion: 2.1 time: 0.276049 Feb 03 02:57:19.548115 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 85/156] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:19 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:20.111639 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-589c0692-f3ae-41ff-b749-0f7139e1606c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:20.112707 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-589c0692-f3ae-41ff-b749-0f7139e1606c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:20.119898 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-589c0692-f3ae-41ff-b749-0f7139e1606c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:20.120377 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-589c0692-f3ae-41ff-b749-0f7139e1606c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:20.121210 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-589c0692-f3ae-41ff-b749-0f7139e1606c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:20.121640 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-589c0692-f3ae-41ff-b749-0f7139e1606c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:20.220633 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-e6f89a53-d3eb-4484-93d3-7aaac65ba5e6 req-54352cb5-a821-4e5c-8405-c5a35e6a12fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a00957e-c905-4466-8a03-befe71ab1e1c", "name": "network-vif-plugged", "status": "completed", "tag": "303c8ce3-0afd-4cac-878f-a7307e3741d0"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:57:20.222585 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:57:20.222585 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 02:57:20.230229 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-e6f89a53-d3eb-4484-93d3-7aaac65ba5e6 req-54352cb5-a821-4e5c-8405-c5a35e6a12fc service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:20.230770 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-e6f89a53-d3eb-4484-93d3-7aaac65ba5e6 req-54352cb5-a821-4e5c-8405-c5a35e6a12fc service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:20.243710 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-e6f89a53-d3eb-4484-93d3-7aaac65ba5e6 req-54352cb5-a821-4e5c-8405-c5a35e6a12fc service nova] Creating event network-vif-plugged:303c8ce3-0afd-4cac-878f-a7307e3741d0 for instance 9a00957e-c905-4466-8a03-befe71ab1e1c on hv-cinder-82758 Feb 03 02:57:20.250042 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-e6f89a53-d3eb-4484-93d3-7aaac65ba5e6 req-54352cb5-a821-4e5c-8405-c5a35e6a12fc service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032161 Feb 03 02:57:20.251182 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 86/157] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 03 02:57:20.288377 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-953d9bc2-1141-4adf-9829-ecb17cb52a6a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:20.289111 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-953d9bc2-1141-4adf-9829-ecb17cb52a6a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:20.295861 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-953d9bc2-1141-4adf-9829-ecb17cb52a6a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:20.296377 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-953d9bc2-1141-4adf-9829-ecb17cb52a6a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:20.297269 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-953d9bc2-1141-4adf-9829-ecb17cb52a6a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:20.297952 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-953d9bc2-1141-4adf-9829-ecb17cb52a6a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:20.319710 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-589c0692-f3ae-41ff-b749-0f7139e1606c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:20.328901 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-589c0692-f3ae-41ff-b749-0f7139e1606c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1314 microversion: 2.1 time: 0.224117 Feb 03 02:57:20.329532 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 72/158] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:20 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:20.430882 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-953d9bc2-1141-4adf-9829-ecb17cb52a6a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:20.438489 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-953d9bc2-1141-4adf-9829-ecb17cb52a6a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1364 microversion: 2.1 time: 0.154366 Feb 03 02:57:20.439238 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 87/159] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:20 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:20.456220 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-85fa7680-b34c-4baa-9d32-84fa22029a7e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:20.456841 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-85fa7680-b34c-4baa-9d32-84fa22029a7e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:20.462747 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-85fa7680-b34c-4baa-9d32-84fa22029a7e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:20.463191 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-85fa7680-b34c-4baa-9d32-84fa22029a7e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:20.463987 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-85fa7680-b34c-4baa-9d32-84fa22029a7e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:20.464497 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-85fa7680-b34c-4baa-9d32-84fa22029a7e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:20.553656 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-3370c286-c865-41ac-8634-0662134d844e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:20.554361 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-3370c286-c865-41ac-8634-0662134d844e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:20.562741 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3370c286-c865-41ac-8634-0662134d844e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:20.563399 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3370c286-c865-41ac-8634-0662134d844e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:20.564186 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3370c286-c865-41ac-8634-0662134d844e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:20.564609 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3370c286-c865-41ac-8634-0662134d844e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:20.618328 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-85fa7680-b34c-4baa-9d32-84fa22029a7e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:20.626104 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-85fa7680-b34c-4baa-9d32-84fa22029a7e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1321 microversion: 2.1 time: 0.173870 Feb 03 02:57:20.626793 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 73/160] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:20 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:20.632660 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-fc8ed2cd-fa76-4072-ba4a-89dd4fd07aee tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:20.633458 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-fc8ed2cd-fa76-4072-ba4a-89dd4fd07aee tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:20.638691 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-3370c286-c865-41ac-8634-0662134d844e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:20.639855 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fc8ed2cd-fa76-4072-ba4a-89dd4fd07aee tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:20.640383 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fc8ed2cd-fa76-4072-ba4a-89dd4fd07aee tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:20.641352 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fc8ed2cd-fa76-4072-ba4a-89dd4fd07aee tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:20.641878 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fc8ed2cd-fa76-4072-ba4a-89dd4fd07aee tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:20.646254 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-3370c286-c865-41ac-8634-0662134d844e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c" status: 200 len: 1217 microversion: 2.1 time: 0.096449 Feb 03 02:57:20.647027 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 88/161] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:20 2022] GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:20.777269 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-fc8ed2cd-fa76-4072-ba4a-89dd4fd07aee tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:20.785601 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-fc8ed2cd-fa76-4072-ba4a-89dd4fd07aee tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1318 microversion: 2.1 time: 0.157317 Feb 03 02:57:20.786261 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 74/162] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:20 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:21.351189 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-55c184a3-4ad5-43e5-9687-e0a5d321de10 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:21.351745 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-55c184a3-4ad5-43e5-9687-e0a5d321de10 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:21.358122 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-55c184a3-4ad5-43e5-9687-e0a5d321de10 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:21.358554 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-55c184a3-4ad5-43e5-9687-e0a5d321de10 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:21.359317 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-55c184a3-4ad5-43e5-9687-e0a5d321de10 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:21.359735 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-55c184a3-4ad5-43e5-9687-e0a5d321de10 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:21.455135 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-2ef12d89-13b3-4a3b-8fbc-2eced46374cb tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:21.455753 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-2ef12d89-13b3-4a3b-8fbc-2eced46374cb tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:21.462418 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2ef12d89-13b3-4a3b-8fbc-2eced46374cb tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:21.463082 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2ef12d89-13b3-4a3b-8fbc-2eced46374cb tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:21.463664 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2ef12d89-13b3-4a3b-8fbc-2eced46374cb tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:21.464126 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2ef12d89-13b3-4a3b-8fbc-2eced46374cb tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:21.738626 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-55c184a3-4ad5-43e5-9687-e0a5d321de10 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:21.743199 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-2ef12d89-13b3-4a3b-8fbc-2eced46374cb tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:21.746142 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-55c184a3-4ad5-43e5-9687-e0a5d321de10 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1314 microversion: 2.1 time: 0.398566 Feb 03 02:57:21.746702 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 89/163] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:21 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:21.751341 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-19801085-bbe4-4920-97cb-7ed5238aae8b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:21.751932 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-19801085-bbe4-4920-97cb-7ed5238aae8b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:21.757104 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-2ef12d89-13b3-4a3b-8fbc-2eced46374cb tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1364 microversion: 2.1 time: 0.305527 Feb 03 02:57:21.757704 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-19801085-bbe4-4920-97cb-7ed5238aae8b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:21.767021 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-19801085-bbe4-4920-97cb-7ed5238aae8b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:21.767451 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 75/164] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:21 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1364 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:21.767529 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-19801085-bbe4-4920-97cb-7ed5238aae8b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:21.767529 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-19801085-bbe4-4920-97cb-7ed5238aae8b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:21.767690 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-f2dafec8-01b0-430d-b33c-0d4c311f6756 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:21.767690 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-f2dafec8-01b0-430d-b33c-0d4c311f6756 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:21.771033 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f2dafec8-01b0-430d-b33c-0d4c311f6756 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:21.771477 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f2dafec8-01b0-430d-b33c-0d4c311f6756 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:21.772310 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f2dafec8-01b0-430d-b33c-0d4c311f6756 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:21.772876 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f2dafec8-01b0-430d-b33c-0d4c311f6756 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:21.867936 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-f2dafec8-01b0-430d-b33c-0d4c311f6756 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:21.894427 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-f2dafec8-01b0-430d-b33c-0d4c311f6756 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c" status: 200 len: 1209 microversion: 2.1 time: 0.134786 Feb 03 02:57:21.910881 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 76/165] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:21 2022] GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c => generated 1209 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:21.916416 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-deb161bb-94f9-4d3b-b6c3-7de949015668 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:21.922080 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-deb161bb-94f9-4d3b-b6c3-7de949015668 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:21.940363 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-deb161bb-94f9-4d3b-b6c3-7de949015668 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:21.940916 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-deb161bb-94f9-4d3b-b6c3-7de949015668 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:21.941748 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-deb161bb-94f9-4d3b-b6c3-7de949015668 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:21.942125 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-deb161bb-94f9-4d3b-b6c3-7de949015668 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:21.946086 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-19801085-bbe4-4920-97cb-7ed5238aae8b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:21.957501 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-19801085-bbe4-4920-97cb-7ed5238aae8b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1321 microversion: 2.1 time: 0.209753 Feb 03 02:57:21.958447 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 90/166] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:21 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:22.099802 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-deb161bb-94f9-4d3b-b6c3-7de949015668 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:22.107963 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-deb161bb-94f9-4d3b-b6c3-7de949015668 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1318 microversion: 2.1 time: 0.195942 Feb 03 02:57:22.118024 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 77/167] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:21 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:22.765509 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-fec27639-7ddd-4d8c-995d-0c56e07af9f8 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:22.766082 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-fec27639-7ddd-4d8c-995d-0c56e07af9f8 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:22.773299 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fec27639-7ddd-4d8c-995d-0c56e07af9f8 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:22.776749 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fec27639-7ddd-4d8c-995d-0c56e07af9f8 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:22.776749 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fec27639-7ddd-4d8c-995d-0c56e07af9f8 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:22.777050 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-d3f6f09d-10d8-42a6-8109-e7bde349f974 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:22.777478 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fec27639-7ddd-4d8c-995d-0c56e07af9f8 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:22.777553 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-d3f6f09d-10d8-42a6-8109-e7bde349f974 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:22.782187 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d3f6f09d-10d8-42a6-8109-e7bde349f974 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:22.782901 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d3f6f09d-10d8-42a6-8109-e7bde349f974 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:22.783688 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d3f6f09d-10d8-42a6-8109-e7bde349f974 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:22.784258 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d3f6f09d-10d8-42a6-8109-e7bde349f974 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:23.000937 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-fec27639-7ddd-4d8c-995d-0c56e07af9f8 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:23.010977 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-d3f6f09d-10d8-42a6-8109-e7bde349f974 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:23.013505 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-fec27639-7ddd-4d8c-995d-0c56e07af9f8 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1314 microversion: 2.1 time: 0.251880 Feb 03 02:57:23.014600 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 91/168] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:22 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:23.019561 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-e8c1cfe8-db69-477f-840c-83cdbe435f30 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:23.020830 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-e8c1cfe8-db69-477f-840c-83cdbe435f30 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:23.021441 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-d3f6f09d-10d8-42a6-8109-e7bde349f974 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1364 microversion: 2.1 time: 0.250114 Feb 03 02:57:23.022659 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 78/169] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:22 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1364 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:23.026365 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e8c1cfe8-db69-477f-840c-83cdbe435f30 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:23.026843 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e8c1cfe8-db69-477f-840c-83cdbe435f30 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:23.027737 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e8c1cfe8-db69-477f-840c-83cdbe435f30 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:23.028219 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-d5cfeec0-3160-4329-ab28-c16d66843f77 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:23.028366 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e8c1cfe8-db69-477f-840c-83cdbe435f30 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:23.029026 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-d5cfeec0-3160-4329-ab28-c16d66843f77 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:23.038623 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d5cfeec0-3160-4329-ab28-c16d66843f77 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:23.039161 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d5cfeec0-3160-4329-ab28-c16d66843f77 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:23.040077 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d5cfeec0-3160-4329-ab28-c16d66843f77 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:23.040582 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d5cfeec0-3160-4329-ab28-c16d66843f77 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:23.101388 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-e8c1cfe8-db69-477f-840c-83cdbe435f30 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:23.108871 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-e8c1cfe8-db69-477f-840c-83cdbe435f30 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c" status: 200 len: 1265 microversion: 2.1 time: 0.093129 Feb 03 02:57:23.109478 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 92/170] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:23 2022] GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c => generated 1265 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:23.125357 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-a454bfa2-c5fe-4cfb-bc71-dd4f9e214541 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:23.126222 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-a454bfa2-c5fe-4cfb-bc71-dd4f9e214541 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:23.134505 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a454bfa2-c5fe-4cfb-bc71-dd4f9e214541 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:23.135323 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a454bfa2-c5fe-4cfb-bc71-dd4f9e214541 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:23.136108 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a454bfa2-c5fe-4cfb-bc71-dd4f9e214541 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:23.136528 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a454bfa2-c5fe-4cfb-bc71-dd4f9e214541 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:23.235889 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-d5cfeec0-3160-4329-ab28-c16d66843f77 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:23.243454 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-d5cfeec0-3160-4329-ab28-c16d66843f77 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1321 microversion: 2.1 time: 0.219513 Feb 03 02:57:23.244045 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 79/171] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:23 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:23.301667 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-a454bfa2-c5fe-4cfb-bc71-dd4f9e214541 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:23.309159 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-a454bfa2-c5fe-4cfb-bc71-dd4f9e214541 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1509 microversion: 2.1 time: 0.187857 Feb 03 02:57:23.309747 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 93/172] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:23 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1509 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:24.042942 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-ba96f0f2-2f53-46b7-b5c6-b1a43da911c9 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:24.043865 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-ba96f0f2-2f53-46b7-b5c6-b1a43da911c9 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:24.045387 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-1aa52edd-1997-4111-a215-215222322be7 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:24.046357 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-1aa52edd-1997-4111-a215-215222322be7 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:24.052825 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ba96f0f2-2f53-46b7-b5c6-b1a43da911c9 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:24.053013 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1aa52edd-1997-4111-a215-215222322be7 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:24.053256 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ba96f0f2-2f53-46b7-b5c6-b1a43da911c9 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:24.053447 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1aa52edd-1997-4111-a215-215222322be7 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:24.054029 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ba96f0f2-2f53-46b7-b5c6-b1a43da911c9 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:24.054214 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1aa52edd-1997-4111-a215-215222322be7 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:24.054496 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ba96f0f2-2f53-46b7-b5c6-b1a43da911c9 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:24.054640 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1aa52edd-1997-4111-a215-215222322be7 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:24.251635 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-ba96f0f2-2f53-46b7-b5c6-b1a43da911c9 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:24.254659 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-1aa52edd-1997-4111-a215-215222322be7 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:24.259298 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-ba96f0f2-2f53-46b7-b5c6-b1a43da911c9 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1364 microversion: 2.1 time: 0.222689 Feb 03 02:57:24.260022 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 80/173] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:24 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:24.264413 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-f8750583-7b21-45f2-8209-0f006b76804f tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:24.265032 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-f8750583-7b21-45f2-8209-0f006b76804f tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:24.267541 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-1aa52edd-1997-4111-a215-215222322be7 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1314 microversion: 2.1 time: 0.228041 Feb 03 02:57:24.274390 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 94/174] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:24 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:24.274532 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f8750583-7b21-45f2-8209-0f006b76804f tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:24.274532 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f8750583-7b21-45f2-8209-0f006b76804f tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:24.274703 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-bd400d90-95eb-438e-8231-c604e52f3b3e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:24.274779 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f8750583-7b21-45f2-8209-0f006b76804f tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:24.274849 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-bd400d90-95eb-438e-8231-c604e52f3b3e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:24.274916 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f8750583-7b21-45f2-8209-0f006b76804f tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:24.279147 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-bd400d90-95eb-438e-8231-c604e52f3b3e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:24.279595 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-bd400d90-95eb-438e-8231-c604e52f3b3e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:24.280369 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-bd400d90-95eb-438e-8231-c604e52f3b3e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:24.280788 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-bd400d90-95eb-438e-8231-c604e52f3b3e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:24.351546 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-f8750583-7b21-45f2-8209-0f006b76804f tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:24.359606 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-f8750583-7b21-45f2-8209-0f006b76804f tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c" status: 200 len: 1265 microversion: 2.1 time: 0.098446 Feb 03 02:57:24.360191 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 81/175] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:24 2022] GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c => generated 1265 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:24.446227 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-bd400d90-95eb-438e-8231-c604e52f3b3e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:24.456086 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-bd400d90-95eb-438e-8231-c604e52f3b3e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1321 microversion: 2.1 time: 0.187043 Feb 03 02:57:24.456646 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 95/176] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:24 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:25.275564 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-141cbd8a-2051-4d6a-ad60-ce393eba85e5 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:25.276267 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-141cbd8a-2051-4d6a-ad60-ce393eba85e5 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:25.282712 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-141cbd8a-2051-4d6a-ad60-ce393eba85e5 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:25.283141 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-141cbd8a-2051-4d6a-ad60-ce393eba85e5 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:25.283887 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-319ba49a-49be-48b9-955c-909b89a1952c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:25.284327 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-141cbd8a-2051-4d6a-ad60-ce393eba85e5 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:25.284327 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-141cbd8a-2051-4d6a-ad60-ce393eba85e5 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:25.284483 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-319ba49a-49be-48b9-955c-909b89a1952c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:25.290739 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-319ba49a-49be-48b9-955c-909b89a1952c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:25.291459 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-319ba49a-49be-48b9-955c-909b89a1952c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:25.292346 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-319ba49a-49be-48b9-955c-909b89a1952c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:25.292796 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-319ba49a-49be-48b9-955c-909b89a1952c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:25.518443 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-319ba49a-49be-48b9-955c-909b89a1952c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:25.524292 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-141cbd8a-2051-4d6a-ad60-ce393eba85e5 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:25.526032 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-319ba49a-49be-48b9-955c-909b89a1952c tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1314 microversion: 2.1 time: 0.246403 Feb 03 02:57:25.526805 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 96/177] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:25 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:25.531738 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-141cbd8a-2051-4d6a-ad60-ce393eba85e5 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1364 microversion: 2.1 time: 0.260009 Feb 03 02:57:25.531963 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-af54928b-eedf-47a5-9bc7-f9fdef28384a tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:25.532337 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 82/178] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:25 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1364 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:25.532931 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-af54928b-eedf-47a5-9bc7-f9fdef28384a tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:25.537931 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-7cd9efb8-f808-4254-b0bc-ff7f871885ae tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:25.538514 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-7cd9efb8-f808-4254-b0bc-ff7f871885ae tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:25.540070 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-af54928b-eedf-47a5-9bc7-f9fdef28384a tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:25.540547 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-af54928b-eedf-47a5-9bc7-f9fdef28384a tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:25.541432 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-af54928b-eedf-47a5-9bc7-f9fdef28384a tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:25.541856 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-af54928b-eedf-47a5-9bc7-f9fdef28384a tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:25.544496 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7cd9efb8-f808-4254-b0bc-ff7f871885ae tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:25.544975 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7cd9efb8-f808-4254-b0bc-ff7f871885ae tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:25.545751 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7cd9efb8-f808-4254-b0bc-ff7f871885ae tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:25.546402 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7cd9efb8-f808-4254-b0bc-ff7f871885ae tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:25.627598 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-af54928b-eedf-47a5-9bc7-f9fdef28384a tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:25.652788 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-af54928b-eedf-47a5-9bc7-f9fdef28384a tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c" status: 200 len: 1265 microversion: 2.1 time: 0.116681 Feb 03 02:57:25.652788 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 97/179] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:25 2022] GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c => generated 1265 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:25.715541 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-7cd9efb8-f808-4254-b0bc-ff7f871885ae tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:25.727057 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-7cd9efb8-f808-4254-b0bc-ff7f871885ae tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1513 microversion: 2.1 time: 0.193712 Feb 03 02:57:25.727675 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 83/180] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:25 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:25.744444 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-96c24495-d095-43cd-beec-1a53423534fd tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:57:25.745487 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-96c24495-d095-43cd-beec-1a53423534fd tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:25.751750 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-96c24495-d095-43cd-beec-1a53423534fd tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:25.752189 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-96c24495-d095-43cd-beec-1a53423534fd tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:25.753176 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-96c24495-d095-43cd-beec-1a53423534fd tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:25.753607 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-96c24495-d095-43cd-beec-1a53423534fd tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:25.815959 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.objects.instance [None req-96c24495-d095-43cd-beec-1a53423534fd tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lazy-loading 'flavor' on Instance uuid 2abf9364-36a9-416e-831f-00f7508465bd {{(pid=116386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 03 02:57:25.989007 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-96c24495-d095-43cd-beec-1a53423534fd tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "POST /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd/action" status: 200 len: 32 microversion: 2.1 time: 0.248218 Feb 03 02:57:25.993791 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 98/181] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Feb 3 02:57:25 2022] POST /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd/action => generated 32 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 03 02:57:26.000648 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-8178f0ea-63b8-4493-9d87-488d4be9a3a8 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:26.001371 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-8178f0ea-63b8-4493-9d87-488d4be9a3a8 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:26.026864 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8178f0ea-63b8-4493-9d87-488d4be9a3a8 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:26.027321 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8178f0ea-63b8-4493-9d87-488d4be9a3a8 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:26.029694 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8178f0ea-63b8-4493-9d87-488d4be9a3a8 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:26.032404 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8178f0ea-63b8-4493-9d87-488d4be9a3a8 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:26.390802 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-8178f0ea-63b8-4493-9d87-488d4be9a3a8 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:26.402571 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-8178f0ea-63b8-4493-9d87-488d4be9a3a8 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.407239 Feb 03 02:57:26.413536 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 84/182] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:25 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:26.544054 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-e328dcca-01a5-4cc8-b67f-5ac054df9f59 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:26.544743 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-e328dcca-01a5-4cc8-b67f-5ac054df9f59 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:26.548498 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-631f29f6-003c-4f86-8e76-b782f3ea8d0a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:26.549277 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-631f29f6-003c-4f86-8e76-b782f3ea8d0a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:26.551093 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e328dcca-01a5-4cc8-b67f-5ac054df9f59 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:26.551747 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e328dcca-01a5-4cc8-b67f-5ac054df9f59 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:26.552537 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e328dcca-01a5-4cc8-b67f-5ac054df9f59 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:26.552998 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e328dcca-01a5-4cc8-b67f-5ac054df9f59 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:26.555951 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-631f29f6-003c-4f86-8e76-b782f3ea8d0a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:26.556510 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-631f29f6-003c-4f86-8e76-b782f3ea8d0a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:26.557677 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-631f29f6-003c-4f86-8e76-b782f3ea8d0a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:26.558217 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-631f29f6-003c-4f86-8e76-b782f3ea8d0a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:26.972594 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-e328dcca-01a5-4cc8-b67f-5ac054df9f59 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:26.975653 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-631f29f6-003c-4f86-8e76-b782f3ea8d0a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:26.981812 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-e328dcca-01a5-4cc8-b67f-5ac054df9f59 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1501 microversion: 2.1 time: 0.441823 Feb 03 02:57:26.982581 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 99/183] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:26 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1501 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:26.984339 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-631f29f6-003c-4f86-8e76-b782f3ea8d0a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1364 microversion: 2.1 time: 0.439927 Feb 03 02:57:26.985140 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 85/184] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:26 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1364 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:26.987501 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-242a7e28-60fb-4122-9df1-2b0bb466da9b tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:26.988098 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-242a7e28-60fb-4122-9df1-2b0bb466da9b tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:26.989496 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-b1b6d029-9f98-4735-9bed-c4700707ed8b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-552634503", "imageRef": "99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce", "flavorRef": "452"}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:57:27.004764 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-242a7e28-60fb-4122-9df1-2b0bb466da9b tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:27.005340 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-242a7e28-60fb-4122-9df1-2b0bb466da9b tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:27.006893 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-242a7e28-60fb-4122-9df1-2b0bb466da9b tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:27.007778 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-242a7e28-60fb-4122-9df1-2b0bb466da9b tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:27.042653 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.network.neutron [None req-b1b6d029-9f98-4735-9bed-c4700707ed8b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] validate_networks() for None {{(pid=116385) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 03 02:57:27.556276 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-242a7e28-60fb-4122-9df1-2b0bb466da9b tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:27.564242 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-242a7e28-60fb-4122-9df1-2b0bb466da9b tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c" status: 200 len: 1313 microversion: 2.1 time: 0.580274 Feb 03 02:57:27.573950 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 100/185] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:26 2022] GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c => generated 1313 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:27.573950 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-5400abe7-6d36-4e78-a1cd-cbf00500ec7a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e3d52b1-233a-428d-ac48-1a8f27f13174"}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:57:27.573950 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-5400abe7-6d36-4e78-a1cd-cbf00500ec7a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:27.576829 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5400abe7-6d36-4e78-a1cd-cbf00500ec7a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:27.577427 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5400abe7-6d36-4e78-a1cd-cbf00500ec7a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:27.579942 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5400abe7-6d36-4e78-a1cd-cbf00500ec7a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:27.579942 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5400abe7-6d36-4e78-a1cd-cbf00500ec7a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:27.599118 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-b1b6d029-9f98-4735-9bed-c4700707ed8b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Flavor limits 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 03 02:57:27.599627 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-b1b6d029-9f98-4735-9bed-c4700707ed8b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Image limits 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 03 02:57:27.600144 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-b1b6d029-9f98-4735-9bed-c4700707ed8b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Flavor pref 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 03 02:57:27.600537 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-b1b6d029-9f98-4735-9bed-c4700707ed8b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Image pref 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 03 02:57:27.600968 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-b1b6d029-9f98-4735-9bed-c4700707ed8b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 03 02:57:27.610701 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b1b6d029-9f98-4735-9bed-c4700707ed8b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:27.611139 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b1b6d029-9f98-4735-9bed-c4700707ed8b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:27.611938 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b1b6d029-9f98-4735-9bed-c4700707ed8b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:27.612367 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b1b6d029-9f98-4735-9bed-c4700707ed8b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:27.629148 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-b1b6d029-9f98-4735-9bed-c4700707ed8b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Getting quotas for project 32b005a4be7b40aab2f79fc959cd6549. Resources: {'cores', 'ram', 'instances'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 02:57:27.633228 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-b1b6d029-9f98-4735-9bed-c4700707ed8b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Getting quotas for user befc8b34ea6540d3991b23a58f729736 and project 32b005a4be7b40aab2f79fc959cd6549. Resources: {'cores', 'ram', 'instances'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 02:57:27.645435 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-b1b6d029-9f98-4735-9bed-c4700707ed8b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Going to run 1 instances... {{(pid=116385) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 03 02:57:27.647624 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-b1b6d029-9f98-4735-9bed-c4700707ed8b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] [instance: 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 03 02:57:27.694567 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-b1b6d029-9f98-4735-9bed-c4700707ed8b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.708142 Feb 03 02:57:27.695189 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 86/186] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Feb 3 02:57:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 03 02:57:27.699434 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-25ae3054-0983-49f9-a1e4-86cfffb7303b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:27.700371 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-25ae3054-0983-49f9-a1e4-86cfffb7303b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:27.706323 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-25ae3054-0983-49f9-a1e4-86cfffb7303b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:27.706762 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-25ae3054-0983-49f9-a1e4-86cfffb7303b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:27.707530 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-25ae3054-0983-49f9-a1e4-86cfffb7303b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:27.707956 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-25ae3054-0983-49f9-a1e4-86cfffb7303b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:27.843451 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-25ae3054-0983-49f9-a1e4-86cfffb7303b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:27.850875 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-25ae3054-0983-49f9-a1e4-86cfffb7303b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.154752 Feb 03 02:57:27.851452 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 87/187] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:27 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:27.856054 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-d2f4c37a-d5a9-4c33-8212-c807a12f8a75 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:27.856555 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-d2f4c37a-d5a9-4c33-8212-c807a12f8a75 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] [instance: 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:27.906826 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-d2f4c37a-d5a9-4c33-8212-c807a12f8a75 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc8b34ea6540d3991b23a58f729736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b005a4be7b40aab2f79fc959cd6549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:27.913439 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-d2f4c37a-d5a9-4c33-8212-c807a12f8a75 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] 10.222.0.31 "GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49" status: 200 len: 1214 microversion: 2.1 time: 0.061035 Feb 03 02:57:27.914009 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 88/188] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:27 2022] GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49 => generated 1214 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:28.005004 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-dc1cd9e8-972f-435a-a5eb-4027eaad2bf6 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:28.005621 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-dc1cd9e8-972f-435a-a5eb-4027eaad2bf6 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:28.011843 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-dc1cd9e8-972f-435a-a5eb-4027eaad2bf6 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:28.012284 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-dc1cd9e8-972f-435a-a5eb-4027eaad2bf6 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:28.013100 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-dc1cd9e8-972f-435a-a5eb-4027eaad2bf6 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:28.013547 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-dc1cd9e8-972f-435a-a5eb-4027eaad2bf6 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:28.162419 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-dc1cd9e8-972f-435a-a5eb-4027eaad2bf6 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:28.170038 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-dc1cd9e8-972f-435a-a5eb-4027eaad2bf6 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1550 microversion: 2.1 time: 0.168751 Feb 03 02:57:28.170624 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 89/189] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:27 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1550 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:28.186410 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-6de64352-dce0-4b28-a1a6-9eb795196175 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:28.186923 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-6de64352-dce0-4b28-a1a6-9eb795196175 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:28.193437 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6de64352-dce0-4b28-a1a6-9eb795196175 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:28.193884 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6de64352-dce0-4b28-a1a6-9eb795196175 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:28.194664 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6de64352-dce0-4b28-a1a6-9eb795196175 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:28.195094 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6de64352-dce0-4b28-a1a6-9eb795196175 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:28.320753 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-6de64352-dce0-4b28-a1a6-9eb795196175 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137786 Feb 03 02:57:28.321603 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 90/190] 10.222.0.31 () {58 vars in 1274 bytes} [Thu Feb 3 02:57:28 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:57:28.581074 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-7c97b8a1-bf34-409d-891e-3c0af2d27854 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:28.581599 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-7c97b8a1-bf34-409d-891e-3c0af2d27854 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:28.588357 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7c97b8a1-bf34-409d-891e-3c0af2d27854 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:28.588926 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7c97b8a1-bf34-409d-891e-3c0af2d27854 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:28.589691 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7c97b8a1-bf34-409d-891e-3c0af2d27854 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:28.590154 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7c97b8a1-bf34-409d-891e-3c0af2d27854 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:29.073978 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-7c97b8a1-bf34-409d-891e-3c0af2d27854 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:29.082200 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-7c97b8a1-bf34-409d-891e-3c0af2d27854 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c" status: 200 len: 1313 microversion: 2.1 time: 0.504910 Feb 03 02:57:29.091750 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 91/191] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:28 2022] GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c => generated 1313 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:29.091750 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-7fb5735f-14df-4f90-8861-ee0726aca56a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:29.091750 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-7fb5735f-14df-4f90-8861-ee0726aca56a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:29.093982 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7fb5735f-14df-4f90-8861-ee0726aca56a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:29.094424 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7fb5735f-14df-4f90-8861-ee0726aca56a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:29.095233 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7fb5735f-14df-4f90-8861-ee0726aca56a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:29.095661 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7fb5735f-14df-4f90-8861-ee0726aca56a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:29.757627 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-7fb5735f-14df-4f90-8861-ee0726aca56a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:29.765622 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-7fb5735f-14df-4f90-8861-ee0726aca56a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.681869 Feb 03 02:57:29.766389 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 92/192] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:29 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:29.770689 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-52663fa6-977a-45e5-a992-197cf0f9225e tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:29.771343 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-52663fa6-977a-45e5-a992-197cf0f9225e tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] [instance: 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:29.777474 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-52663fa6-977a-45e5-a992-197cf0f9225e tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:29.777904 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-52663fa6-977a-45e5-a992-197cf0f9225e tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:29.778697 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-52663fa6-977a-45e5-a992-197cf0f9225e tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:29.779124 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-52663fa6-977a-45e5-a992-197cf0f9225e tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:29.883114 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-52663fa6-977a-45e5-a992-197cf0f9225e tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc8b34ea6540d3991b23a58f729736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b005a4be7b40aab2f79fc959cd6549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:29.895323 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-52663fa6-977a-45e5-a992-197cf0f9225e tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] 10.222.0.31 "GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49" status: 200 len: 1218 microversion: 2.1 time: 0.127867 Feb 03 02:57:29.896163 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 93/193] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:29 2022] GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49 => generated 1218 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:30.032092 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-5400abe7-6d36-4e78-a1cd-cbf00500ec7a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "POST /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.466001 Feb 03 02:57:30.033408 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 101/194] 10.222.0.31 () {60 vars in 1322 bytes} [Thu Feb 3 02:57:27 2022] POST /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170/os-volume_attachments => generated 194 bytes in 2468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:57:30.100062 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-2391e5b1-a9f4-4049-bb70-ac4a0bc1a16e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:30.101664 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-2391e5b1-a9f4-4049-bb70-ac4a0bc1a16e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:30.109317 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2391e5b1-a9f4-4049-bb70-ac4a0bc1a16e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:30.109787 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2391e5b1-a9f4-4049-bb70-ac4a0bc1a16e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:30.110571 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2391e5b1-a9f4-4049-bb70-ac4a0bc1a16e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:30.110996 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2391e5b1-a9f4-4049-bb70-ac4a0bc1a16e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:30.445606 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-2391e5b1-a9f4-4049-bb70-ac4a0bc1a16e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:30.457351 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-2391e5b1-a9f4-4049-bb70-ac4a0bc1a16e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c" status: 200 len: 1313 microversion: 2.1 time: 0.360075 Feb 03 02:57:30.461901 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 94/195] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:30 2022] GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c => generated 1313 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:30.471401 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-af706892-980d-44e6-bdd2-0a6653c2a0ec tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:30.472818 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-af706892-980d-44e6-bdd2-0a6653c2a0ec tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:30.485141 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-af706892-980d-44e6-bdd2-0a6653c2a0ec tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:30.485590 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-af706892-980d-44e6-bdd2-0a6653c2a0ec tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:30.486327 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-44646810-b00a-4470-9308-52b6e80da756 req-805db079-0940-4cc1-9b94-059e085b01db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a00957e-c905-4466-8a03-befe71ab1e1c", "tag": "303c8ce3-0afd-4cac-878f-a7307e3741d0"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:57:30.486470 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-af706892-980d-44e6-bdd2-0a6653c2a0ec tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:30.486815 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-af706892-980d-44e6-bdd2-0a6653c2a0ec tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:30.489497 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:57:30.489497 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 02:57:30.498763 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-44646810-b00a-4470-9308-52b6e80da756 req-805db079-0940-4cc1-9b94-059e085b01db service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:30.499440 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-44646810-b00a-4470-9308-52b6e80da756 req-805db079-0940-4cc1-9b94-059e085b01db service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:30.511274 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-44646810-b00a-4470-9308-52b6e80da756 req-805db079-0940-4cc1-9b94-059e085b01db service nova] Creating event network-changed:303c8ce3-0afd-4cac-878f-a7307e3741d0 for instance 9a00957e-c905-4466-8a03-befe71ab1e1c on hv-cinder-82758 Feb 03 02:57:30.516536 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-44646810-b00a-4470-9308-52b6e80da756 req-805db079-0940-4cc1-9b94-059e085b01db service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036429 Feb 03 02:57:30.517331 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 95/196] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 03 02:57:30.524244 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-df9358ce-8e5d-4cf1-bb15-df867d1e6c20 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc034d9f-c8d2-4c14-b230-f6e9654f0163"}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:57:30.526890 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-df9358ce-8e5d-4cf1-bb15-df867d1e6c20 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:30.534900 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-df9358ce-8e5d-4cf1-bb15-df867d1e6c20 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:30.535568 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-df9358ce-8e5d-4cf1-bb15-df867d1e6c20 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:30.536542 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-df9358ce-8e5d-4cf1-bb15-df867d1e6c20 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:30.537147 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-df9358ce-8e5d-4cf1-bb15-df867d1e6c20 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:31.035191 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-af706892-980d-44e6-bdd2-0a6653c2a0ec tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:31.043073 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-af706892-980d-44e6-bdd2-0a6653c2a0ec tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1550 microversion: 2.1 time: 0.577866 Feb 03 02:57:31.050479 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 102/197] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:30 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1550 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:31.057083 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-eac4b88e-cf42-463c-9e4f-6d6a0b201d6e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:31.057858 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-eac4b88e-cf42-463c-9e4f-6d6a0b201d6e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:31.078416 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-eac4b88e-cf42-463c-9e4f-6d6a0b201d6e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:31.078957 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-eac4b88e-cf42-463c-9e4f-6d6a0b201d6e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:31.085927 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-eac4b88e-cf42-463c-9e4f-6d6a0b201d6e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:31.086464 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-eac4b88e-cf42-463c-9e4f-6d6a0b201d6e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:31.153556 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-df9358ce-8e5d-4cf1-bb15-df867d1e6c20 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "POST /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.632588 Feb 03 02:57:31.154318 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 96/198] 10.222.0.31 () {60 vars in 1322 bytes} [Thu Feb 3 02:57:30 2022] POST /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183/os-volume_attachments => generated 194 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:57:31.186011 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-4d75caa3-df1f-45f1-9663-0bfc013a5a0c tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:31.188008 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-4d75caa3-df1f-45f1-9663-0bfc013a5a0c tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] [instance: 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:31.203228 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4d75caa3-df1f-45f1-9663-0bfc013a5a0c tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:31.205077 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4d75caa3-df1f-45f1-9663-0bfc013a5a0c tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:31.211584 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4d75caa3-df1f-45f1-9663-0bfc013a5a0c tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:31.212871 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4d75caa3-df1f-45f1-9663-0bfc013a5a0c tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:31.338853 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-4d75caa3-df1f-45f1-9663-0bfc013a5a0c tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc8b34ea6540d3991b23a58f729736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b005a4be7b40aab2f79fc959cd6549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:31.348284 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-4d75caa3-df1f-45f1-9663-0bfc013a5a0c tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] 10.222.0.31 "GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49" status: 200 len: 1272 microversion: 2.1 time: 0.192347 Feb 03 02:57:31.348958 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 97/199] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:31 2022] GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49 => generated 1272 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:31.477919 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-ac8da998-0cf3-4db9-aca3-cef43dcadec1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:31.478886 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-ac8da998-0cf3-4db9-aca3-cef43dcadec1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:31.489968 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ac8da998-0cf3-4db9-aca3-cef43dcadec1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:31.491272 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ac8da998-0cf3-4db9-aca3-cef43dcadec1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:31.493463 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ac8da998-0cf3-4db9-aca3-cef43dcadec1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:31.495011 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ac8da998-0cf3-4db9-aca3-cef43dcadec1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:31.784654 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-eac4b88e-cf42-463c-9e4f-6d6a0b201d6e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:31.792140 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-eac4b88e-cf42-463c-9e4f-6d6a0b201d6e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.740447 Feb 03 02:57:31.796859 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 103/200] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:31 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:31.997366 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-ac8da998-0cf3-4db9-aca3-cef43dcadec1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:32.007146 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-ac8da998-0cf3-4db9-aca3-cef43dcadec1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c" status: 200 len: 1313 microversion: 2.1 time: 0.532905 Feb 03 02:57:32.007729 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 98/201] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:31 2022] GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c => generated 1313 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:32.075015 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-667c1856-9374-4512-8a98-0b658c6bf7d7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:32.078864 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-667c1856-9374-4512-8a98-0b658c6bf7d7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:32.101242 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-667c1856-9374-4512-8a98-0b658c6bf7d7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:32.102031 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-667c1856-9374-4512-8a98-0b658c6bf7d7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:32.104013 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-667c1856-9374-4512-8a98-0b658c6bf7d7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:32.104647 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-667c1856-9374-4512-8a98-0b658c6bf7d7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:32.365981 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-02665871-b161-47e0-934d-11e57e52fbac tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:32.367176 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-02665871-b161-47e0-934d-11e57e52fbac tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] [instance: 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:32.374793 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-02665871-b161-47e0-934d-11e57e52fbac tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:32.375579 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-02665871-b161-47e0-934d-11e57e52fbac tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:32.376579 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-02665871-b161-47e0-934d-11e57e52fbac tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:32.377244 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-02665871-b161-47e0-934d-11e57e52fbac tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:32.410090 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-667c1856-9374-4512-8a98-0b658c6bf7d7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:32.419068 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-667c1856-9374-4512-8a98-0b658c6bf7d7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1550 microversion: 2.1 time: 0.356167 Feb 03 02:57:32.435981 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 104/202] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:32 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1550 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:32.553663 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-cab17081-b7bf-457a-9190-4c65bb07ba13 req-727ff1cf-f963-4cd0-83e2-12d77d42e5ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdafd7ae-560d-4c7a-848e-eb8506ffba4c", "tag": "8eb17e7f-c7af-449c-8842-be520b097cba"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:57:32.555247 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:57:32.555247 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 02:57:32.574179 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-cab17081-b7bf-457a-9190-4c65bb07ba13 req-727ff1cf-f963-4cd0-83e2-12d77d42e5ae service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:32.574607 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-cab17081-b7bf-457a-9190-4c65bb07ba13 req-727ff1cf-f963-4cd0-83e2-12d77d42e5ae service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:32.620290 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-02665871-b161-47e0-934d-11e57e52fbac tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc8b34ea6540d3991b23a58f729736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b005a4be7b40aab2f79fc959cd6549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:32.629647 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-02665871-b161-47e0-934d-11e57e52fbac tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] 10.222.0.31 "GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49" status: 200 len: 1314 microversion: 2.1 time: 0.266608 Feb 03 02:57:32.630353 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 99/203] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:32 2022] GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:32.735899 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-cab17081-b7bf-457a-9190-4c65bb07ba13 req-727ff1cf-f963-4cd0-83e2-12d77d42e5ae service nova] Creating event network-changed:8eb17e7f-c7af-449c-8842-be520b097cba for instance bdafd7ae-560d-4c7a-848e-eb8506ffba4c on hv-cinder-82758 Feb 03 02:57:32.740996 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-cab17081-b7bf-457a-9190-4c65bb07ba13 req-727ff1cf-f963-4cd0-83e2-12d77d42e5ae service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190759 Feb 03 02:57:32.741680 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 105/204] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 03 02:57:32.812249 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-acc058d5-b188-4386-bad8-4ad32bf9534a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:32.812888 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-acc058d5-b188-4386-bad8-4ad32bf9534a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:32.818843 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-acc058d5-b188-4386-bad8-4ad32bf9534a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:32.819284 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-acc058d5-b188-4386-bad8-4ad32bf9534a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:32.820039 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-acc058d5-b188-4386-bad8-4ad32bf9534a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:32.820628 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-acc058d5-b188-4386-bad8-4ad32bf9534a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:33.021730 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-acc058d5-b188-4386-bad8-4ad32bf9534a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:33.027367 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-ef8ad84c-0f8e-44f5-b630-65cbe2d68f9e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:33.028210 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-ef8ad84c-0f8e-44f5-b630-65cbe2d68f9e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:33.029720 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-acc058d5-b188-4386-bad8-4ad32bf9534a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.221100 Feb 03 02:57:33.030634 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 100/205] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:32 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:33.053518 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ef8ad84c-0f8e-44f5-b630-65cbe2d68f9e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:33.054132 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ef8ad84c-0f8e-44f5-b630-65cbe2d68f9e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:33.055030 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ef8ad84c-0f8e-44f5-b630-65cbe2d68f9e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:33.055686 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ef8ad84c-0f8e-44f5-b630-65cbe2d68f9e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:33.114446 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-a512d285-ed2b-4da6-a67c-0636f3c5a0cf req-7c743535-1c78-4e55-b305-4861edb2a284 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49", "tag": "2da89c94-dd76-4f49-8a5b-207f79792eaf"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:57:33.116082 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:57:33.116082 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 02:57:33.123598 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-a512d285-ed2b-4da6-a67c-0636f3c5a0cf req-7c743535-1c78-4e55-b305-4861edb2a284 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:33.124303 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-a512d285-ed2b-4da6-a67c-0636f3c5a0cf req-7c743535-1c78-4e55-b305-4861edb2a284 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:33.138687 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-a512d285-ed2b-4da6-a67c-0636f3c5a0cf req-7c743535-1c78-4e55-b305-4861edb2a284 service nova] Creating event network-changed:2da89c94-dd76-4f49-8a5b-207f79792eaf for instance 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49 on hv-cinder-82758 Feb 03 02:57:33.144037 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-a512d285-ed2b-4da6-a67c-0636f3c5a0cf req-7c743535-1c78-4e55-b305-4861edb2a284 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033946 Feb 03 02:57:33.145230 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 101/206] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 03 02:57:33.302852 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-ef8ad84c-0f8e-44f5-b630-65cbe2d68f9e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:33.315079 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-ef8ad84c-0f8e-44f5-b630-65cbe2d68f9e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c" status: 200 len: 1313 microversion: 2.1 time: 0.294583 Feb 03 02:57:33.325392 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 106/207] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:33 2022] GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:33.435870 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-098b6cf1-2b0a-40aa-9140-81cc997c5b89 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:33.436506 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-098b6cf1-2b0a-40aa-9140-81cc997c5b89 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:33.445955 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-098b6cf1-2b0a-40aa-9140-81cc997c5b89 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:33.446583 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-098b6cf1-2b0a-40aa-9140-81cc997c5b89 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:33.447481 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-098b6cf1-2b0a-40aa-9140-81cc997c5b89 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:33.450034 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-098b6cf1-2b0a-40aa-9140-81cc997c5b89 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:33.612770 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-098b6cf1-2b0a-40aa-9140-81cc997c5b89 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:33.621553 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-098b6cf1-2b0a-40aa-9140-81cc997c5b89 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1669 microversion: 2.1 time: 0.189546 Feb 03 02:57:33.629098 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 102/208] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:33 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1669 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:33.638137 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-fd81e78b-69fa-4ee9-8493-19225dcb102f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:33.638627 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-fd81e78b-69fa-4ee9-8493-19225dcb102f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:33.646099 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fd81e78b-69fa-4ee9-8493-19225dcb102f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:33.646765 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fd81e78b-69fa-4ee9-8493-19225dcb102f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:33.647698 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fd81e78b-69fa-4ee9-8493-19225dcb102f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:33.648276 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fd81e78b-69fa-4ee9-8493-19225dcb102f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:33.649699 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-1f6721ea-f685-44ad-9862-906a256fcc63 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:33.650313 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-1f6721ea-f685-44ad-9862-906a256fcc63 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] [instance: 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:33.660007 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1f6721ea-f685-44ad-9862-906a256fcc63 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:33.660436 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1f6721ea-f685-44ad-9862-906a256fcc63 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:33.661255 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1f6721ea-f685-44ad-9862-906a256fcc63 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:33.661685 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1f6721ea-f685-44ad-9862-906a256fcc63 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:33.675886 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-fd81e78b-69fa-4ee9-8493-19225dcb102f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c/ips" status: 200 len: 146 microversion: 2.1 time: 0.041299 Feb 03 02:57:33.689673 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 107/209] 10.222.0.31 () {58 vars in 1247 bytes} [Thu Feb 3 02:57:33 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c/ips => generated 146 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:57:33.820599 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-1f6721ea-f685-44ad-9862-906a256fcc63 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc8b34ea6540d3991b23a58f729736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b005a4be7b40aab2f79fc959cd6549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:33.827947 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-1f6721ea-f685-44ad-9862-906a256fcc63 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] 10.222.0.31 "GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49" status: 200 len: 1314 microversion: 2.1 time: 0.184363 Feb 03 02:57:33.828584 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 103/210] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:33 2022] GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:34.046872 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-db99ae9e-f5cf-49e1-a805-0223c3b88916 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:34.047479 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-db99ae9e-f5cf-49e1-a805-0223c3b88916 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:34.053544 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-db99ae9e-f5cf-49e1-a805-0223c3b88916 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:34.053994 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-db99ae9e-f5cf-49e1-a805-0223c3b88916 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:34.054778 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-db99ae9e-f5cf-49e1-a805-0223c3b88916 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:34.055207 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-db99ae9e-f5cf-49e1-a805-0223c3b88916 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:34.187735 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-db99ae9e-f5cf-49e1-a805-0223c3b88916 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:34.195051 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-db99ae9e-f5cf-49e1-a805-0223c3b88916 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.152149 Feb 03 02:57:34.204369 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 108/211] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:34 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:34.332818 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-81166e96-a070-484a-8e98-6f367e3d5d2b tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:34.333384 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-81166e96-a070-484a-8e98-6f367e3d5d2b tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:34.339663 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-81166e96-a070-484a-8e98-6f367e3d5d2b tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:34.340101 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-81166e96-a070-484a-8e98-6f367e3d5d2b tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:34.340948 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-81166e96-a070-484a-8e98-6f367e3d5d2b tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:34.341374 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-81166e96-a070-484a-8e98-6f367e3d5d2b tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:34.489468 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-81166e96-a070-484a-8e98-6f367e3d5d2b tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:34.495583 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-81166e96-a070-484a-8e98-6f367e3d5d2b tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c" status: 200 len: 1313 microversion: 2.1 time: 0.166505 Feb 03 02:57:34.496144 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 104/212] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:34 2022] GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:34.844458 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-a1e88b7b-0f0e-42b0-b091-9cdea36051a6 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:34.845199 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-a1e88b7b-0f0e-42b0-b091-9cdea36051a6 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] [instance: 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:34.852081 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a1e88b7b-0f0e-42b0-b091-9cdea36051a6 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:34.852736 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a1e88b7b-0f0e-42b0-b091-9cdea36051a6 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:34.853744 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a1e88b7b-0f0e-42b0-b091-9cdea36051a6 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:34.854176 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a1e88b7b-0f0e-42b0-b091-9cdea36051a6 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:34.987514 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-a1e88b7b-0f0e-42b0-b091-9cdea36051a6 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc8b34ea6540d3991b23a58f729736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b005a4be7b40aab2f79fc959cd6549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:34.995054 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-a1e88b7b-0f0e-42b0-b091-9cdea36051a6 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] 10.222.0.31 "GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49" status: 200 len: 1314 microversion: 2.1 time: 0.154423 Feb 03 02:57:34.995642 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 109/213] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:34 2022] GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:35.211352 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-30ebc75b-4d46-4912-9478-e902f0b63e33 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:35.211864 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-30ebc75b-4d46-4912-9478-e902f0b63e33 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:35.217888 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-30ebc75b-4d46-4912-9478-e902f0b63e33 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:35.218342 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-30ebc75b-4d46-4912-9478-e902f0b63e33 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:35.219159 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-30ebc75b-4d46-4912-9478-e902f0b63e33 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:35.219610 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-30ebc75b-4d46-4912-9478-e902f0b63e33 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:35.355870 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-30ebc75b-4d46-4912-9478-e902f0b63e33 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:35.363278 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-30ebc75b-4d46-4912-9478-e902f0b63e33 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.155712 Feb 03 02:57:35.363838 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 105/214] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:35 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:35.514515 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-9bef6c22-0932-4626-bc59-c8a7e5a92720 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:35.515212 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-9bef6c22-0932-4626-bc59-c8a7e5a92720 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:35.523016 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-9bef6c22-0932-4626-bc59-c8a7e5a92720 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:35.523529 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-9bef6c22-0932-4626-bc59-c8a7e5a92720 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:35.524372 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-9bef6c22-0932-4626-bc59-c8a7e5a92720 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:35.524831 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-9bef6c22-0932-4626-bc59-c8a7e5a92720 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:35.694655 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-9bef6c22-0932-4626-bc59-c8a7e5a92720 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:35.704311 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-9bef6c22-0932-4626-bc59-c8a7e5a92720 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c" status: 200 len: 1313 microversion: 2.1 time: 0.193880 Feb 03 02:57:35.705233 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 110/215] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:35 2022] GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:36.011402 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-997f0e56-a950-4548-92d3-a81eadde54bc tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:36.011998 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-997f0e56-a950-4548-92d3-a81eadde54bc tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] [instance: 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:36.018185 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-997f0e56-a950-4548-92d3-a81eadde54bc tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:36.018624 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-997f0e56-a950-4548-92d3-a81eadde54bc tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:36.019384 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-997f0e56-a950-4548-92d3-a81eadde54bc tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:36.019804 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-997f0e56-a950-4548-92d3-a81eadde54bc tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:36.218698 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-997f0e56-a950-4548-92d3-a81eadde54bc tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc8b34ea6540d3991b23a58f729736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b005a4be7b40aab2f79fc959cd6549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:36.226434 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-997f0e56-a950-4548-92d3-a81eadde54bc tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] 10.222.0.31 "GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49" status: 200 len: 1314 microversion: 2.1 time: 0.218658 Feb 03 02:57:36.227011 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 106/216] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:36 2022] GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:36.380941 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-2e7eef45-306b-484d-ab2f-7ee6aa731303 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:36.381538 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-2e7eef45-306b-484d-ab2f-7ee6aa731303 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:36.389066 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2e7eef45-306b-484d-ab2f-7ee6aa731303 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:36.389714 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2e7eef45-306b-484d-ab2f-7ee6aa731303 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:36.390965 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2e7eef45-306b-484d-ab2f-7ee6aa731303 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:36.391400 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2e7eef45-306b-484d-ab2f-7ee6aa731303 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:36.530998 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-2e7eef45-306b-484d-ab2f-7ee6aa731303 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:36.539416 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-2e7eef45-306b-484d-ab2f-7ee6aa731303 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.162178 Feb 03 02:57:36.539954 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 111/217] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:36 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:36.722384 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-d82a2381-346d-4b9d-9c7c-6049b425540e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:36.723252 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-d82a2381-346d-4b9d-9c7c-6049b425540e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:36.729738 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d82a2381-346d-4b9d-9c7c-6049b425540e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:36.730120 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d82a2381-346d-4b9d-9c7c-6049b425540e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:36.730905 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d82a2381-346d-4b9d-9c7c-6049b425540e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:36.731334 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d82a2381-346d-4b9d-9c7c-6049b425540e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:36.871145 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-d82a2381-346d-4b9d-9c7c-6049b425540e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:36.878447 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-d82a2381-346d-4b9d-9c7c-6049b425540e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c" status: 200 len: 1313 microversion: 2.1 time: 0.160671 Feb 03 02:57:36.879669 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 107/218] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:36 2022] GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:37.243635 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-4576ec1a-af54-4fb1-ae20-0a81866623be tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:37.244331 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-4576ec1a-af54-4fb1-ae20-0a81866623be tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] [instance: 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:37.250348 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4576ec1a-af54-4fb1-ae20-0a81866623be tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:37.250793 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4576ec1a-af54-4fb1-ae20-0a81866623be tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:37.251599 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4576ec1a-af54-4fb1-ae20-0a81866623be tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:37.252043 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4576ec1a-af54-4fb1-ae20-0a81866623be tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:37.385277 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-4576ec1a-af54-4fb1-ae20-0a81866623be tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc8b34ea6540d3991b23a58f729736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b005a4be7b40aab2f79fc959cd6549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:37.393518 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-4576ec1a-af54-4fb1-ae20-0a81866623be tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] 10.222.0.31 "GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49" status: 200 len: 1314 microversion: 2.1 time: 0.153609 Feb 03 02:57:37.394084 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 112/219] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:37 2022] GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:37.558909 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-992547a2-bd29-414f-84c2-86b1e5916a40 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:37.559886 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-992547a2-bd29-414f-84c2-86b1e5916a40 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:37.567267 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-992547a2-bd29-414f-84c2-86b1e5916a40 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:37.567713 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-992547a2-bd29-414f-84c2-86b1e5916a40 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:37.568484 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-992547a2-bd29-414f-84c2-86b1e5916a40 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:37.568938 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-992547a2-bd29-414f-84c2-86b1e5916a40 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:37.711627 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-992547a2-bd29-414f-84c2-86b1e5916a40 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:37.719627 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-992547a2-bd29-414f-84c2-86b1e5916a40 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.166839 Feb 03 02:57:37.724524 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 108/220] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:37 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:37.895265 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-0be2525e-80bf-4586-9ad6-d54f9df55d31 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:37.895865 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-0be2525e-80bf-4586-9ad6-d54f9df55d31 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:37.902221 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0be2525e-80bf-4586-9ad6-d54f9df55d31 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:37.902660 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0be2525e-80bf-4586-9ad6-d54f9df55d31 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:37.903407 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0be2525e-80bf-4586-9ad6-d54f9df55d31 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:37.903983 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0be2525e-80bf-4586-9ad6-d54f9df55d31 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:38.053275 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-0be2525e-80bf-4586-9ad6-d54f9df55d31 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:38.060646 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-0be2525e-80bf-4586-9ad6-d54f9df55d31 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c" status: 200 len: 1313 microversion: 2.1 time: 0.169128 Feb 03 02:57:38.061585 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 113/221] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:37 2022] GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:38.412092 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-524a36ae-97bd-4cfa-bdcb-fc92e0017f17 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:38.412685 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-524a36ae-97bd-4cfa-bdcb-fc92e0017f17 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] [instance: 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:38.419369 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-524a36ae-97bd-4cfa-bdcb-fc92e0017f17 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:38.419752 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-524a36ae-97bd-4cfa-bdcb-fc92e0017f17 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:38.420535 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-524a36ae-97bd-4cfa-bdcb-fc92e0017f17 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:38.421145 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-524a36ae-97bd-4cfa-bdcb-fc92e0017f17 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:38.558740 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-524a36ae-97bd-4cfa-bdcb-fc92e0017f17 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc8b34ea6540d3991b23a58f729736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b005a4be7b40aab2f79fc959cd6549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:38.566704 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-524a36ae-97bd-4cfa-bdcb-fc92e0017f17 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] 10.222.0.31 "GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49" status: 200 len: 1314 microversion: 2.1 time: 0.159374 Feb 03 02:57:38.567292 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 109/222] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:38 2022] GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:38.736994 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-0c8aeff5-26ab-4560-8ff5-9ceaebc8ae73 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:38.737591 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-0c8aeff5-26ab-4560-8ff5-9ceaebc8ae73 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:38.744303 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0c8aeff5-26ab-4560-8ff5-9ceaebc8ae73 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:38.744747 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0c8aeff5-26ab-4560-8ff5-9ceaebc8ae73 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:38.745549 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0c8aeff5-26ab-4560-8ff5-9ceaebc8ae73 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:38.745973 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0c8aeff5-26ab-4560-8ff5-9ceaebc8ae73 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:38.799016 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-ebbc90d4-b7ff-49e6-9215-6b7dd67d3a05 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2089196127", "imageRef": "99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce", "flavorRef": "452", "networks": [{"uuid": "126c5997-2080-4b93-9c71-959073b0550c"}]}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:57:38.850958 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.network.neutron [None req-ebbc90d4-b7ff-49e6-9215-6b7dd67d3a05 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] validate_networks() for [('126c5997-2080-4b93-9c71-959073b0550c', None, None, None, None, None)] {{(pid=116385) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 03 02:57:38.900275 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-0c8aeff5-26ab-4560-8ff5-9ceaebc8ae73 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:38.908002 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-0c8aeff5-26ab-4560-8ff5-9ceaebc8ae73 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.174841 Feb 03 02:57:38.908566 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 114/223] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:38 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:39.078312 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-0e7ccbdb-db0b-4b43-9408-0eea5da3542e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:39.092537 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-0e7ccbdb-db0b-4b43-9408-0eea5da3542e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:39.099538 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0e7ccbdb-db0b-4b43-9408-0eea5da3542e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:39.099986 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0e7ccbdb-db0b-4b43-9408-0eea5da3542e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:39.100824 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0e7ccbdb-db0b-4b43-9408-0eea5da3542e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:39.101251 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0e7ccbdb-db0b-4b43-9408-0eea5da3542e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:39.418173 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-0e7ccbdb-db0b-4b43-9408-0eea5da3542e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:39.425963 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-0e7ccbdb-db0b-4b43-9408-0eea5da3542e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c" status: 200 len: 1313 microversion: 2.1 time: 0.351964 Feb 03 02:57:39.426719 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 115/224] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:39 2022] GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:39.529136 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-ebbc90d4-b7ff-49e6-9215-6b7dd67d3a05 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Flavor limits 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 03 02:57:39.529711 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-ebbc90d4-b7ff-49e6-9215-6b7dd67d3a05 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Image limits 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 03 02:57:39.530352 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-ebbc90d4-b7ff-49e6-9215-6b7dd67d3a05 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Flavor pref 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 03 02:57:39.530993 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-ebbc90d4-b7ff-49e6-9215-6b7dd67d3a05 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Image pref 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 03 02:57:39.531568 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-ebbc90d4-b7ff-49e6-9215-6b7dd67d3a05 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 03 02:57:39.545163 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ebbc90d4-b7ff-49e6-9215-6b7dd67d3a05 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:39.545800 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ebbc90d4-b7ff-49e6-9215-6b7dd67d3a05 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:39.546985 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ebbc90d4-b7ff-49e6-9215-6b7dd67d3a05 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:39.547620 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ebbc90d4-b7ff-49e6-9215-6b7dd67d3a05 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:39.564689 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-ebbc90d4-b7ff-49e6-9215-6b7dd67d3a05 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Getting quotas for project ff777728bb704feeabf264e753679daa. Resources: {'cores', 'ram', 'instances'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 02:57:39.568555 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-ebbc90d4-b7ff-49e6-9215-6b7dd67d3a05 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Getting quotas for user 087b5f4f3891413b8b7fa727768c09a4 and project ff777728bb704feeabf264e753679daa. Resources: {'cores', 'ram', 'instances'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 02:57:39.579334 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-ebbc90d4-b7ff-49e6-9215-6b7dd67d3a05 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Going to run 1 instances... {{(pid=116385) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 03 02:57:39.581681 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-ebbc90d4-b7ff-49e6-9215-6b7dd67d3a05 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 543ff03e-fd92-42d9-8121-5aa22a1bd45d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 03 02:57:39.583213 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-f2b71ce9-e48c-4618-bcde-75a4461a4264 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:39.583813 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-f2b71ce9-e48c-4618-bcde-75a4461a4264 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] [instance: 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:39.590255 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f2b71ce9-e48c-4618-bcde-75a4461a4264 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:39.590692 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f2b71ce9-e48c-4618-bcde-75a4461a4264 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:39.591476 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f2b71ce9-e48c-4618-bcde-75a4461a4264 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:39.591977 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f2b71ce9-e48c-4618-bcde-75a4461a4264 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:39.628350 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-ebbc90d4-b7ff-49e6-9215-6b7dd67d3a05 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.832813 Feb 03 02:57:39.629033 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 110/225] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Feb 3 02:57:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 03 02:57:39.639513 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-a5092a18-47af-4189-82a7-2bf25d21ec38 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:39.640095 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-a5092a18-47af-4189-82a7-2bf25d21ec38 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 543ff03e-fd92-42d9-8121-5aa22a1bd45d] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:39.694719 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-a5092a18-47af-4189-82a7-2bf25d21ec38 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:39.702986 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-a5092a18-47af-4189-82a7-2bf25d21ec38 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d" status: 200 len: 1218 microversion: 2.1 time: 0.067592 Feb 03 02:57:39.703629 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 111/226] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:39 2022] GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:39.761849 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-f2b71ce9-e48c-4618-bcde-75a4461a4264 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc8b34ea6540d3991b23a58f729736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b005a4be7b40aab2f79fc959cd6549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:39.769540 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-f2b71ce9-e48c-4618-bcde-75a4461a4264 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] 10.222.0.31 "GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49" status: 200 len: 1314 microversion: 2.1 time: 0.189901 Feb 03 02:57:39.778669 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 116/227] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:39 2022] GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:39.928393 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-f983dc7f-777b-4302-8d1a-e47b1d7e274f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:39.929560 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-f983dc7f-777b-4302-8d1a-e47b1d7e274f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:39.939708 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f983dc7f-777b-4302-8d1a-e47b1d7e274f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:39.940464 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f983dc7f-777b-4302-8d1a-e47b1d7e274f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:39.941783 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f983dc7f-777b-4302-8d1a-e47b1d7e274f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:39.942559 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f983dc7f-777b-4302-8d1a-e47b1d7e274f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:40.094803 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-f983dc7f-777b-4302-8d1a-e47b1d7e274f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:40.102675 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-f983dc7f-777b-4302-8d1a-e47b1d7e274f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.181031 Feb 03 02:57:40.103609 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 112/228] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:39 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:40.442905 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-1ecea70e-2586-47a4-b082-aabeb0cdfe44 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:40.443510 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-1ecea70e-2586-47a4-b082-aabeb0cdfe44 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:40.450177 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1ecea70e-2586-47a4-b082-aabeb0cdfe44 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:40.450621 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1ecea70e-2586-47a4-b082-aabeb0cdfe44 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:40.451408 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1ecea70e-2586-47a4-b082-aabeb0cdfe44 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:40.451842 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1ecea70e-2586-47a4-b082-aabeb0cdfe44 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:40.586836 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-1ecea70e-2586-47a4-b082-aabeb0cdfe44 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:40.596943 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-1ecea70e-2586-47a4-b082-aabeb0cdfe44 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c" status: 200 len: 1313 microversion: 2.1 time: 0.157451 Feb 03 02:57:40.597907 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 117/229] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:40 2022] GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:40.720072 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-e2016105-9c72-4089-8cdf-c3e9d4261a75 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:40.720668 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-e2016105-9c72-4089-8cdf-c3e9d4261a75 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 543ff03e-fd92-42d9-8121-5aa22a1bd45d] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:40.727370 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e2016105-9c72-4089-8cdf-c3e9d4261a75 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:40.727809 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e2016105-9c72-4089-8cdf-c3e9d4261a75 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:40.728983 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e2016105-9c72-4089-8cdf-c3e9d4261a75 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:40.729406 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e2016105-9c72-4089-8cdf-c3e9d4261a75 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:40.786021 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-e98c4d37-bead-4981-8351-d40c3d6d19d0 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:40.786617 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-e98c4d37-bead-4981-8351-d40c3d6d19d0 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] [instance: 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:40.788505 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-e2016105-9c72-4089-8cdf-c3e9d4261a75 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:40.793196 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e98c4d37-bead-4981-8351-d40c3d6d19d0 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:40.793639 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e98c4d37-bead-4981-8351-d40c3d6d19d0 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:40.794424 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e98c4d37-bead-4981-8351-d40c3d6d19d0 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:40.794853 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e98c4d37-bead-4981-8351-d40c3d6d19d0 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:40.796679 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-e2016105-9c72-4089-8cdf-c3e9d4261a75 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d" status: 200 len: 1222 microversion: 2.1 time: 0.080456 Feb 03 02:57:40.797576 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 113/230] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:40 2022] GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:40.929114 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-e98c4d37-bead-4981-8351-d40c3d6d19d0 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc8b34ea6540d3991b23a58f729736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b005a4be7b40aab2f79fc959cd6549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:40.936292 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-e98c4d37-bead-4981-8351-d40c3d6d19d0 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] 10.222.0.31 "GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49" status: 200 len: 1314 microversion: 2.1 time: 0.154069 Feb 03 02:57:40.936849 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 118/231] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:40 2022] GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:41.120593 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-00768701-75d8-4736-af8d-9059780a8ba4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:41.121287 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-00768701-75d8-4736-af8d-9059780a8ba4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:41.128320 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-00768701-75d8-4736-af8d-9059780a8ba4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:41.128880 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-00768701-75d8-4736-af8d-9059780a8ba4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:41.129741 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-00768701-75d8-4736-af8d-9059780a8ba4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:41.130231 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-00768701-75d8-4736-af8d-9059780a8ba4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:41.268424 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-00768701-75d8-4736-af8d-9059780a8ba4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:41.276421 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-00768701-75d8-4736-af8d-9059780a8ba4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.159974 Feb 03 02:57:41.277042 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 114/232] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:41 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:41.614571 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-d71e5f6b-8591-40b4-af00-40ea1b1bedd0 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:41.615168 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-d71e5f6b-8591-40b4-af00-40ea1b1bedd0 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:41.626784 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d71e5f6b-8591-40b4-af00-40ea1b1bedd0 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:41.627430 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d71e5f6b-8591-40b4-af00-40ea1b1bedd0 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:41.628681 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d71e5f6b-8591-40b4-af00-40ea1b1bedd0 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:41.629414 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d71e5f6b-8591-40b4-af00-40ea1b1bedd0 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:41.814728 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-430e6104-cb11-4c38-aa1d-9581414793b0 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:41.815322 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-430e6104-cb11-4c38-aa1d-9581414793b0 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 543ff03e-fd92-42d9-8121-5aa22a1bd45d] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:41.822203 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-430e6104-cb11-4c38-aa1d-9581414793b0 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:41.822649 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-430e6104-cb11-4c38-aa1d-9581414793b0 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:41.823413 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-430e6104-cb11-4c38-aa1d-9581414793b0 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:41.824052 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-430e6104-cb11-4c38-aa1d-9581414793b0 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:41.877879 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-d71e5f6b-8591-40b4-af00-40ea1b1bedd0 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:41.886358 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-d71e5f6b-8591-40b4-af00-40ea1b1bedd0 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c" status: 200 len: 1313 microversion: 2.1 time: 0.275467 Feb 03 02:57:41.896302 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 119/233] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:41 2022] GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:41.953407 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-4a1872ba-6711-4a46-b2e0-bcb1468c12b0 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:41.954135 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-4a1872ba-6711-4a46-b2e0-bcb1468c12b0 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] [instance: 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:41.964312 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4a1872ba-6711-4a46-b2e0-bcb1468c12b0 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:41.966793 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4a1872ba-6711-4a46-b2e0-bcb1468c12b0 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:41.968263 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4a1872ba-6711-4a46-b2e0-bcb1468c12b0 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:41.970202 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4a1872ba-6711-4a46-b2e0-bcb1468c12b0 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:42.065071 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-430e6104-cb11-4c38-aa1d-9581414793b0 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:42.080998 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-430e6104-cb11-4c38-aa1d-9581414793b0 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d" status: 200 len: 1270 microversion: 2.1 time: 0.268517 Feb 03 02:57:42.082873 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 115/234] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:41 2022] GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d => generated 1270 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:42.233294 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-4a1872ba-6711-4a46-b2e0-bcb1468c12b0 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc8b34ea6540d3991b23a58f729736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b005a4be7b40aab2f79fc959cd6549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:42.241377 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-4a1872ba-6711-4a46-b2e0-bcb1468c12b0 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] 10.222.0.31 "GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49" status: 200 len: 1314 microversion: 2.1 time: 0.292221 Feb 03 02:57:42.251036 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 120/235] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:41 2022] GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:42.293044 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-0fa055c5-5b9d-4fdf-88b4-f3ed82d85736 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:42.293703 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-0fa055c5-5b9d-4fdf-88b4-f3ed82d85736 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:42.300115 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0fa055c5-5b9d-4fdf-88b4-f3ed82d85736 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:42.300573 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0fa055c5-5b9d-4fdf-88b4-f3ed82d85736 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:42.301380 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0fa055c5-5b9d-4fdf-88b4-f3ed82d85736 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:42.301974 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0fa055c5-5b9d-4fdf-88b4-f3ed82d85736 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:42.482800 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-0fa055c5-5b9d-4fdf-88b4-f3ed82d85736 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:42.491949 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-0fa055c5-5b9d-4fdf-88b4-f3ed82d85736 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.202401 Feb 03 02:57:42.501530 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 116/236] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:42 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:42.903819 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-3986fa5a-5daf-492f-93b1-b9642d1bda6a tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:42.904752 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-3986fa5a-5daf-492f-93b1-b9642d1bda6a tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:42.911609 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3986fa5a-5daf-492f-93b1-b9642d1bda6a tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:42.912160 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3986fa5a-5daf-492f-93b1-b9642d1bda6a tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:42.913424 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3986fa5a-5daf-492f-93b1-b9642d1bda6a tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:42.914208 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3986fa5a-5daf-492f-93b1-b9642d1bda6a tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:43.098430 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-5315030f-9e00-45ca-97c4-f59b934e7742 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:43.099048 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-5315030f-9e00-45ca-97c4-f59b934e7742 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 543ff03e-fd92-42d9-8121-5aa22a1bd45d] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:43.105500 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5315030f-9e00-45ca-97c4-f59b934e7742 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:43.105928 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5315030f-9e00-45ca-97c4-f59b934e7742 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:43.106893 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5315030f-9e00-45ca-97c4-f59b934e7742 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:43.107464 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5315030f-9e00-45ca-97c4-f59b934e7742 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:43.142197 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-3986fa5a-5daf-492f-93b1-b9642d1bda6a tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:43.150425 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-3986fa5a-5daf-492f-93b1-b9642d1bda6a tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c" status: 200 len: 1313 microversion: 2.1 time: 0.250751 Feb 03 02:57:43.151154 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 121/237] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:42 2022] GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:43.255601 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-5315030f-9e00-45ca-97c4-f59b934e7742 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:43.258492 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-0cc6c54d-964c-474f-9fdf-fabf0de9971b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:43.259129 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-0cc6c54d-964c-474f-9fdf-fabf0de9971b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] [instance: 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:43.263883 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-5315030f-9e00-45ca-97c4-f59b934e7742 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d" status: 200 len: 1318 microversion: 2.1 time: 0.169107 Feb 03 02:57:43.265110 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0cc6c54d-964c-474f-9fdf-fabf0de9971b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:43.265562 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0cc6c54d-964c-474f-9fdf-fabf0de9971b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:43.266290 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 117/238] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:43 2022] GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:43.266419 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0cc6c54d-964c-474f-9fdf-fabf0de9971b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:43.266804 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0cc6c54d-964c-474f-9fdf-fabf0de9971b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:43.409495 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-0cc6c54d-964c-474f-9fdf-fabf0de9971b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc8b34ea6540d3991b23a58f729736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b005a4be7b40aab2f79fc959cd6549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:43.420628 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-0cc6c54d-964c-474f-9fdf-fabf0de9971b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] 10.222.0.31 "GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49" status: 200 len: 1314 microversion: 2.1 time: 0.165634 Feb 03 02:57:43.434155 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 122/239] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:43 2022] GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:43.508216 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-3586ed6d-3a3c-480c-ad9b-45b2d3a8b6cf tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:43.508741 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-3586ed6d-3a3c-480c-ad9b-45b2d3a8b6cf tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:43.518516 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3586ed6d-3a3c-480c-ad9b-45b2d3a8b6cf tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:43.518998 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3586ed6d-3a3c-480c-ad9b-45b2d3a8b6cf tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:43.519803 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3586ed6d-3a3c-480c-ad9b-45b2d3a8b6cf tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:43.520245 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3586ed6d-3a3c-480c-ad9b-45b2d3a8b6cf tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:43.624887 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-3ff337c6-34ba-45c3-ac45-1494d95b478a req-f7075e60-afcc-4f1b-a9ca-d298729268be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdafd7ae-560d-4c7a-848e-eb8506ffba4c", "name": "network-vif-plugged", "status": "completed", "tag": "8eb17e7f-c7af-449c-8842-be520b097cba"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:57:43.626696 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:57:43.626696 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 02:57:43.637854 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-3ff337c6-34ba-45c3-ac45-1494d95b478a req-f7075e60-afcc-4f1b-a9ca-d298729268be service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:43.638779 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-3ff337c6-34ba-45c3-ac45-1494d95b478a req-f7075e60-afcc-4f1b-a9ca-d298729268be service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:43.650956 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-3ff337c6-34ba-45c3-ac45-1494d95b478a req-f7075e60-afcc-4f1b-a9ca-d298729268be service nova] Creating event network-vif-plugged:8eb17e7f-c7af-449c-8842-be520b097cba for instance bdafd7ae-560d-4c7a-848e-eb8506ffba4c on hv-cinder-82758 Feb 03 02:57:43.656196 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-3ff337c6-34ba-45c3-ac45-1494d95b478a req-f7075e60-afcc-4f1b-a9ca-d298729268be service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035156 Feb 03 02:57:43.656836 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 123/240] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:57:43.699745 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-3586ed6d-3a3c-480c-ad9b-45b2d3a8b6cf tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:43.709123 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-3586ed6d-3a3c-480c-ad9b-45b2d3a8b6cf tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.204490 Feb 03 02:57:43.709809 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 118/241] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:43 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:43.863446 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-6abef6c5-7ea5-4822-8010-f50fdb303e81 req-e1d4fc85-80f2-48ea-995a-56a8bb76ccc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "543ff03e-fd92-42d9-8121-5aa22a1bd45d", "tag": "65f4c02d-138c-4fb0-aae2-8b37b8e7ee12"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:57:43.866260 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:57:43.866260 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 02:57:43.882885 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-6abef6c5-7ea5-4822-8010-f50fdb303e81 req-e1d4fc85-80f2-48ea-995a-56a8bb76ccc8 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:43.883329 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-6abef6c5-7ea5-4822-8010-f50fdb303e81 req-e1d4fc85-80f2-48ea-995a-56a8bb76ccc8 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:43.896015 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-6abef6c5-7ea5-4822-8010-f50fdb303e81 req-e1d4fc85-80f2-48ea-995a-56a8bb76ccc8 service nova] Creating event network-changed:65f4c02d-138c-4fb0-aae2-8b37b8e7ee12 for instance 543ff03e-fd92-42d9-8121-5aa22a1bd45d on hv-cinder-82758 Feb 03 02:57:43.921017 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-6abef6c5-7ea5-4822-8010-f50fdb303e81 req-e1d4fc85-80f2-48ea-995a-56a8bb76ccc8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066931 Feb 03 02:57:43.923734 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 124/242] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:57:44.167379 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-83988022-a30f-4fa8-a311-3c0391d2912b tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:44.168145 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-83988022-a30f-4fa8-a311-3c0391d2912b tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:44.174637 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-83988022-a30f-4fa8-a311-3c0391d2912b tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:44.175174 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-83988022-a30f-4fa8-a311-3c0391d2912b tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:44.175983 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-83988022-a30f-4fa8-a311-3c0391d2912b tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:44.176424 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-83988022-a30f-4fa8-a311-3c0391d2912b tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:44.284703 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-1675f99d-2560-4a45-b3a1-286f418c8f49 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:44.285585 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-1675f99d-2560-4a45-b3a1-286f418c8f49 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 543ff03e-fd92-42d9-8121-5aa22a1bd45d] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:44.292523 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1675f99d-2560-4a45-b3a1-286f418c8f49 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:44.293232 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1675f99d-2560-4a45-b3a1-286f418c8f49 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:44.294090 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1675f99d-2560-4a45-b3a1-286f418c8f49 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:44.294587 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1675f99d-2560-4a45-b3a1-286f418c8f49 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:44.342186 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-83988022-a30f-4fa8-a311-3c0391d2912b tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:44.350679 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-83988022-a30f-4fa8-a311-3c0391d2912b tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c" status: 200 len: 1313 microversion: 2.1 time: 0.187080 Feb 03 02:57:44.351416 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 119/243] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:44 2022] GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:44.436999 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-3179457b-a737-4942-a99c-7b61f86a24cf tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:44.437829 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-3179457b-a737-4942-a99c-7b61f86a24cf tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] [instance: 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:44.445305 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3179457b-a737-4942-a99c-7b61f86a24cf tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:44.445942 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3179457b-a737-4942-a99c-7b61f86a24cf tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:44.446923 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3179457b-a737-4942-a99c-7b61f86a24cf tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:44.447408 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3179457b-a737-4942-a99c-7b61f86a24cf tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:44.567481 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-1675f99d-2560-4a45-b3a1-286f418c8f49 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:44.575520 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-1675f99d-2560-4a45-b3a1-286f418c8f49 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d" status: 200 len: 1318 microversion: 2.1 time: 0.295729 Feb 03 02:57:44.576104 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 125/244] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:44 2022] GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:44.708215 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-3179457b-a737-4942-a99c-7b61f86a24cf tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc8b34ea6540d3991b23a58f729736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b005a4be7b40aab2f79fc959cd6549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:44.714090 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-3179457b-a737-4942-a99c-7b61f86a24cf tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] 10.222.0.31 "GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49" status: 200 len: 1314 microversion: 2.1 time: 0.280644 Feb 03 02:57:44.714775 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 120/245] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:44 2022] GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:44.725709 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-c2f194eb-6450-412d-9953-3250f3030f8b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:44.726377 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-c2f194eb-6450-412d-9953-3250f3030f8b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:44.733405 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c2f194eb-6450-412d-9953-3250f3030f8b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:44.734042 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c2f194eb-6450-412d-9953-3250f3030f8b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:44.735188 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c2f194eb-6450-412d-9953-3250f3030f8b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:44.735678 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c2f194eb-6450-412d-9953-3250f3030f8b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:44.962312 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-c2f194eb-6450-412d-9953-3250f3030f8b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:44.970404 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-c2f194eb-6450-412d-9953-3250f3030f8b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.248448 Feb 03 02:57:44.971149 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 126/246] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:44 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:45.367159 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-fd3b83bf-b003-4339-86ba-1326c7a9b903 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:45.368633 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-fd3b83bf-b003-4339-86ba-1326c7a9b903 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:45.375014 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fd3b83bf-b003-4339-86ba-1326c7a9b903 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:45.375441 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fd3b83bf-b003-4339-86ba-1326c7a9b903 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:45.376382 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fd3b83bf-b003-4339-86ba-1326c7a9b903 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:45.376833 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fd3b83bf-b003-4339-86ba-1326c7a9b903 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:45.524894 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-fd3b83bf-b003-4339-86ba-1326c7a9b903 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:45.532746 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-fd3b83bf-b003-4339-86ba-1326c7a9b903 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c" status: 200 len: 1313 microversion: 2.1 time: 0.169189 Feb 03 02:57:45.533293 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 121/247] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:45 2022] GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:45.592521 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-35e0c048-c8de-4cd9-943c-5014d068157c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:45.593301 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-35e0c048-c8de-4cd9-943c-5014d068157c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 543ff03e-fd92-42d9-8121-5aa22a1bd45d] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:45.602855 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-35e0c048-c8de-4cd9-943c-5014d068157c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:45.604228 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-35e0c048-c8de-4cd9-943c-5014d068157c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:45.605593 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-35e0c048-c8de-4cd9-943c-5014d068157c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:45.606126 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-35e0c048-c8de-4cd9-943c-5014d068157c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:45.707288 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-bda9db05-e430-4506-b3c4-ec2cd9b1346a req-a1c5c8c1-52d9-448a-a559-f3844d576adb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49", "name": "network-vif-plugged", "status": "completed", "tag": "2da89c94-dd76-4f49-8a5b-207f79792eaf"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:57:45.709131 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:57:45.709131 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 02:57:45.716135 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-bda9db05-e430-4506-b3c4-ec2cd9b1346a req-a1c5c8c1-52d9-448a-a559-f3844d576adb service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:45.716779 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-bda9db05-e430-4506-b3c4-ec2cd9b1346a req-a1c5c8c1-52d9-448a-a559-f3844d576adb service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:45.732378 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-bda9db05-e430-4506-b3c4-ec2cd9b1346a req-a1c5c8c1-52d9-448a-a559-f3844d576adb service nova] Creating event network-vif-plugged:2da89c94-dd76-4f49-8a5b-207f79792eaf for instance 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49 on hv-cinder-82758 Feb 03 02:57:45.738018 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-bda9db05-e430-4506-b3c4-ec2cd9b1346a req-a1c5c8c1-52d9-448a-a559-f3844d576adb service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034368 Feb 03 02:57:45.738830 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 122/248] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 03 02:57:45.743952 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-9066c899-3560-42a5-ab34-b13273b5afc8 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:45.744622 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-9066c899-3560-42a5-ab34-b13273b5afc8 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] [instance: 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:45.750963 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9066c899-3560-42a5-ab34-b13273b5afc8 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:45.751390 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9066c899-3560-42a5-ab34-b13273b5afc8 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:45.752165 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9066c899-3560-42a5-ab34-b13273b5afc8 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:45.752999 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9066c899-3560-42a5-ab34-b13273b5afc8 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:45.910697 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-35e0c048-c8de-4cd9-943c-5014d068157c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:45.919609 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-35e0c048-c8de-4cd9-943c-5014d068157c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d" status: 200 len: 1318 microversion: 2.1 time: 0.330678 Feb 03 02:57:45.920519 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 127/249] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:45 2022] GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:45.987720 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-5ff11f76-b4d0-4a6d-8c80-3414b317a95a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:45.988372 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-5ff11f76-b4d0-4a6d-8c80-3414b317a95a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:45.994744 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5ff11f76-b4d0-4a6d-8c80-3414b317a95a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:45.995182 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5ff11f76-b4d0-4a6d-8c80-3414b317a95a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:45.996001 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5ff11f76-b4d0-4a6d-8c80-3414b317a95a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:45.996388 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5ff11f76-b4d0-4a6d-8c80-3414b317a95a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:46.320967 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-9066c899-3560-42a5-ab34-b13273b5afc8 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc8b34ea6540d3991b23a58f729736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b005a4be7b40aab2f79fc959cd6549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:46.330072 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-9066c899-3560-42a5-ab34-b13273b5afc8 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] 10.222.0.31 "GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49" status: 200 len: 1314 microversion: 2.1 time: 0.589755 Feb 03 02:57:46.339602 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 123/250] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:45 2022] GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49 => generated 1314 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:46.442013 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-5ff11f76-b4d0-4a6d-8c80-3414b317a95a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:46.450557 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-5ff11f76-b4d0-4a6d-8c80-3414b317a95a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.466785 Feb 03 02:57:46.451345 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 128/251] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:45 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:46.549774 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-23bbbe9d-441c-4f54-becb-8efce315b5bb tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:46.551011 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-23bbbe9d-441c-4f54-becb-8efce315b5bb tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:46.557842 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-23bbbe9d-441c-4f54-becb-8efce315b5bb tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:46.558262 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-23bbbe9d-441c-4f54-becb-8efce315b5bb tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:46.559145 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-23bbbe9d-441c-4f54-becb-8efce315b5bb tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:46.559608 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-23bbbe9d-441c-4f54-becb-8efce315b5bb tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:46.703745 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-23bbbe9d-441c-4f54-becb-8efce315b5bb tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:46.711484 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-23bbbe9d-441c-4f54-becb-8efce315b5bb tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c" status: 200 len: 1497 microversion: 2.1 time: 0.165310 Feb 03 02:57:46.712055 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 124/252] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:46 2022] GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:46.936499 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-2aed13b8-9c52-4048-992f-30219a4781da tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:46.937158 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-2aed13b8-9c52-4048-992f-30219a4781da tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 543ff03e-fd92-42d9-8121-5aa22a1bd45d] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:46.946789 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2aed13b8-9c52-4048-992f-30219a4781da tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:46.953051 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2aed13b8-9c52-4048-992f-30219a4781da tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:46.954084 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2aed13b8-9c52-4048-992f-30219a4781da tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:46.954688 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2aed13b8-9c52-4048-992f-30219a4781da tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:47.143388 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-2aed13b8-9c52-4048-992f-30219a4781da tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:47.151683 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-2aed13b8-9c52-4048-992f-30219a4781da tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d" status: 200 len: 1318 microversion: 2.1 time: 0.219033 Feb 03 02:57:47.152313 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 129/253] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:46 2022] GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:47.234527 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-e4605be5-c557-48b4-b66b-e8d447ec1569 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:47.235282 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-e4605be5-c557-48b4-b66b-e8d447ec1569 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:47.241177 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e4605be5-c557-48b4-b66b-e8d447ec1569 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:47.241650 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e4605be5-c557-48b4-b66b-e8d447ec1569 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:47.242617 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e4605be5-c557-48b4-b66b-e8d447ec1569 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:47.243036 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e4605be5-c557-48b4-b66b-e8d447ec1569 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:47.271093 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-e4605be5-c557-48b4-b66b-e8d447ec1569 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] Going to try to terminate instance {{(pid=116385) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 03 02:57:47.346865 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-08f37e78-74a3-4a74-9d4f-a392a98a0df0 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:47.347525 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-08f37e78-74a3-4a74-9d4f-a392a98a0df0 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] [instance: 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:47.355810 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-08f37e78-74a3-4a74-9d4f-a392a98a0df0 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:47.356244 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-08f37e78-74a3-4a74-9d4f-a392a98a0df0 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:47.357058 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-08f37e78-74a3-4a74-9d4f-a392a98a0df0 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:47.357482 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-08f37e78-74a3-4a74-9d4f-a392a98a0df0 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:47.409555 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-e4605be5-c557-48b4-b66b-e8d447ec1569 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "DELETE /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c" status: 204 len: 0 microversion: 2.1 time: 0.176933 Feb 03 02:57:47.411933 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 125/254] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Feb 3 02:57:47 2022] DELETE /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 03 02:57:47.431699 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-3ae7651a-517a-4ea9-bd57-d45baa7765f2 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:47.433388 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-3ae7651a-517a-4ea9-bd57-d45baa7765f2 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:47.439796 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3ae7651a-517a-4ea9-bd57-d45baa7765f2 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:47.440540 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3ae7651a-517a-4ea9-bd57-d45baa7765f2 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:47.441623 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3ae7651a-517a-4ea9-bd57-d45baa7765f2 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:47.442396 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3ae7651a-517a-4ea9-bd57-d45baa7765f2 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:47.557785 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-08f37e78-74a3-4a74-9d4f-a392a98a0df0 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc8b34ea6540d3991b23a58f729736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b005a4be7b40aab2f79fc959cd6549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:47.565814 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-08f37e78-74a3-4a74-9d4f-a392a98a0df0 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] 10.222.0.31 "GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49" status: 200 len: 1314 microversion: 2.1 time: 0.222712 Feb 03 02:57:47.569355 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 130/255] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:47 2022] GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:47.575644 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-8fc22768-1186-4ad4-b75f-d235effd753d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:47.576362 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-8fc22768-1186-4ad4-b75f-d235effd753d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:47.591374 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8fc22768-1186-4ad4-b75f-d235effd753d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:47.593215 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8fc22768-1186-4ad4-b75f-d235effd753d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:47.597091 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8fc22768-1186-4ad4-b75f-d235effd753d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:47.597719 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8fc22768-1186-4ad4-b75f-d235effd753d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:47.708289 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-3ae7651a-517a-4ea9-bd57-d45baa7765f2 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:47.715588 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-3ae7651a-517a-4ea9-bd57-d45baa7765f2 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c" status: 200 len: 1503 microversion: 2.1 time: 0.292013 Feb 03 02:57:47.716157 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 126/256] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:47 2022] GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c => generated 1503 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:47.804354 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-8fc22768-1186-4ad4-b75f-d235effd753d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:47.814993 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-8fc22768-1186-4ad4-b75f-d235effd753d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.244351 Feb 03 02:57:47.816549 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 131/257] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:47 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:48.167906 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-84dc6413-4f86-49cc-a2f0-69b7ac0035bf tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:48.168663 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-84dc6413-4f86-49cc-a2f0-69b7ac0035bf tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 543ff03e-fd92-42d9-8121-5aa22a1bd45d] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:48.175113 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-84dc6413-4f86-49cc-a2f0-69b7ac0035bf tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:48.175920 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-84dc6413-4f86-49cc-a2f0-69b7ac0035bf tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:48.177226 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-84dc6413-4f86-49cc-a2f0-69b7ac0035bf tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:48.178064 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-84dc6413-4f86-49cc-a2f0-69b7ac0035bf tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:48.365415 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-84dc6413-4f86-49cc-a2f0-69b7ac0035bf tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:48.373380 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-84dc6413-4f86-49cc-a2f0-69b7ac0035bf tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d" status: 200 len: 1318 microversion: 2.1 time: 0.208899 Feb 03 02:57:48.374163 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 127/258] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:48 2022] GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:48.585908 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-4a7ce4e8-267b-4329-87bb-299c2f3b7558 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:48.587272 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-4a7ce4e8-267b-4329-87bb-299c2f3b7558 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] [instance: 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:48.596140 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4a7ce4e8-267b-4329-87bb-299c2f3b7558 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:48.597968 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4a7ce4e8-267b-4329-87bb-299c2f3b7558 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:48.600853 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4a7ce4e8-267b-4329-87bb-299c2f3b7558 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:48.601525 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4a7ce4e8-267b-4329-87bb-299c2f3b7558 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:48.733212 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-a8439dbb-8a29-45cd-9e64-751bd70fc21c tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:48.734520 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-a8439dbb-8a29-45cd-9e64-751bd70fc21c tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:48.745422 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a8439dbb-8a29-45cd-9e64-751bd70fc21c tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:48.746961 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a8439dbb-8a29-45cd-9e64-751bd70fc21c tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:48.749360 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a8439dbb-8a29-45cd-9e64-751bd70fc21c tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:48.749948 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a8439dbb-8a29-45cd-9e64-751bd70fc21c tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:48.798042 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-4a7ce4e8-267b-4329-87bb-299c2f3b7558 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc8b34ea6540d3991b23a58f729736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b005a4be7b40aab2f79fc959cd6549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:48.807953 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-4a7ce4e8-267b-4329-87bb-299c2f3b7558 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] 10.222.0.31 "GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49" status: 200 len: 1464 microversion: 2.1 time: 0.226228 Feb 03 02:57:48.808546 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 132/259] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:48 2022] GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49 => generated 1464 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:48.843361 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-dac42884-1933-4bd3-911b-3d60c7642451 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:48.849270 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-dac42884-1933-4bd3-911b-3d60c7642451 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:48.859463 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-dac42884-1933-4bd3-911b-3d60c7642451 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:48.860166 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-dac42884-1933-4bd3-911b-3d60c7642451 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:48.861168 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-dac42884-1933-4bd3-911b-3d60c7642451 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:48.862459 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-dac42884-1933-4bd3-911b-3d60c7642451 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:48.968363 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-a8439dbb-8a29-45cd-9e64-751bd70fc21c tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:48.985317 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-a8439dbb-8a29-45cd-9e64-751bd70fc21c tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c" status: 200 len: 1503 microversion: 2.1 time: 0.255506 Feb 03 02:57:48.986145 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 128/260] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:48 2022] GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c => generated 1503 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:48.990947 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-1e8d38d4-afe0-46fb-b860-d65d757db098 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:48.991434 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-1e8d38d4-afe0-46fb-b860-d65d757db098 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] [instance: 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:49.001972 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1e8d38d4-afe0-46fb-b860-d65d757db098 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:49.002650 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1e8d38d4-afe0-46fb-b860-d65d757db098 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:49.003938 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1e8d38d4-afe0-46fb-b860-d65d757db098 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:49.004526 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1e8d38d4-afe0-46fb-b860-d65d757db098 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:49.035929 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-dac42884-1933-4bd3-911b-3d60c7642451 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:49.036942 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-1e8d38d4-afe0-46fb-b860-d65d757db098 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] [instance: 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49] Going to try to terminate instance {{(pid=116385) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 03 02:57:49.043998 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-dac42884-1933-4bd3-911b-3d60c7642451 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.206062 Feb 03 02:57:49.044579 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 133/261] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:48 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:49.133294 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-1e8d38d4-afe0-46fb-b860-d65d757db098 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] 10.222.0.31 "DELETE /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49" status: 204 len: 0 microversion: 2.1 time: 0.144991 Feb 03 02:57:49.134014 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 129/262] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Feb 3 02:57:48 2022] DELETE /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 03 02:57:49.144785 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-e81b45a2-6d48-49b2-a3cc-5b09a410005e tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:49.146726 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-e81b45a2-6d48-49b2-a3cc-5b09a410005e tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] [instance: 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:49.153926 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e81b45a2-6d48-49b2-a3cc-5b09a410005e tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:49.154552 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e81b45a2-6d48-49b2-a3cc-5b09a410005e tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:49.155581 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e81b45a2-6d48-49b2-a3cc-5b09a410005e tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:49.156016 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e81b45a2-6d48-49b2-a3cc-5b09a410005e tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:49.315915 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-e81b45a2-6d48-49b2-a3cc-5b09a410005e tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc8b34ea6540d3991b23a58f729736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b005a4be7b40aab2f79fc959cd6549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:49.324090 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-e81b45a2-6d48-49b2-a3cc-5b09a410005e tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] 10.222.0.31 "GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49" status: 200 len: 1470 microversion: 2.1 time: 0.185250 Feb 03 02:57:49.324880 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 134/263] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:49 2022] GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49 => generated 1470 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:49.390358 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-559406fe-057d-4106-aedc-59b336fe7151 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:49.391044 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-559406fe-057d-4106-aedc-59b336fe7151 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 543ff03e-fd92-42d9-8121-5aa22a1bd45d] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:49.400876 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-559406fe-057d-4106-aedc-59b336fe7151 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:49.401537 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-559406fe-057d-4106-aedc-59b336fe7151 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:49.403785 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-559406fe-057d-4106-aedc-59b336fe7151 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:49.403785 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-559406fe-057d-4106-aedc-59b336fe7151 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:49.545569 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-028f377b-d8a9-4c6d-9cf8-0fe7b6a24229 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:49.546059 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-028f377b-d8a9-4c6d-9cf8-0fe7b6a24229 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:49.555379 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-028f377b-d8a9-4c6d-9cf8-0fe7b6a24229 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:49.558939 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-028f377b-d8a9-4c6d-9cf8-0fe7b6a24229 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:49.561397 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-028f377b-d8a9-4c6d-9cf8-0fe7b6a24229 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:49.562039 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-028f377b-d8a9-4c6d-9cf8-0fe7b6a24229 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:49.574677 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-559406fe-057d-4106-aedc-59b336fe7151 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:49.582359 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-559406fe-057d-4106-aedc-59b336fe7151 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d" status: 200 len: 1318 microversion: 2.1 time: 0.196082 Feb 03 02:57:49.584006 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 130/264] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:49 2022] GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:49.595755 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-028f377b-d8a9-4c6d-9cf8-0fe7b6a24229 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Going to try to terminate instance {{(pid=116386) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 03 02:57:49.692015 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-028f377b-d8a9-4c6d-9cf8-0fe7b6a24229 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "DELETE /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 204 len: 0 microversion: 2.1 time: 0.149626 Feb 03 02:57:49.692984 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 135/265] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Feb 3 02:57:49 2022] DELETE /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 03 02:57:49.701417 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-e105475e-22bb-45be-8e52-ecaa372e5195 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:49.702146 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-e105475e-22bb-45be-8e52-ecaa372e5195 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:49.710331 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e105475e-22bb-45be-8e52-ecaa372e5195 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:49.710869 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e105475e-22bb-45be-8e52-ecaa372e5195 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:49.712604 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e105475e-22bb-45be-8e52-ecaa372e5195 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:49.713208 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e105475e-22bb-45be-8e52-ecaa372e5195 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:49.857168 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-e105475e-22bb-45be-8e52-ecaa372e5195 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:49.866465 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-e105475e-22bb-45be-8e52-ecaa372e5195 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1553 microversion: 2.1 time: 0.169312 Feb 03 02:57:49.867038 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 131/266] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:49 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:50.003765 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-14a710fb-3453-4264-ae2b-37194cad4678 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:50.004579 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-14a710fb-3453-4264-ae2b-37194cad4678 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:50.011750 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-14a710fb-3453-4264-ae2b-37194cad4678 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:50.012336 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-14a710fb-3453-4264-ae2b-37194cad4678 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:50.013078 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-14a710fb-3453-4264-ae2b-37194cad4678 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:50.013519 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-14a710fb-3453-4264-ae2b-37194cad4678 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:50.060480 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-9560f240-2844-4256-bf55-a61406a155bc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:50.060887 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-9560f240-2844-4256-bf55-a61406a155bc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:50.067198 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9560f240-2844-4256-bf55-a61406a155bc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:50.067850 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9560f240-2844-4256-bf55-a61406a155bc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:50.076775 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9560f240-2844-4256-bf55-a61406a155bc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:50.077297 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9560f240-2844-4256-bf55-a61406a155bc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:50.257119 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-14a710fb-3453-4264-ae2b-37194cad4678 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:50.266841 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-14a710fb-3453-4264-ae2b-37194cad4678 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c" status: 200 len: 1503 microversion: 2.1 time: 0.267298 Feb 03 02:57:50.277119 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 136/267] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:49 2022] GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c => generated 1503 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:50.342070 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-147f41b5-629f-46b6-a5a1-240a0d1772a1 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:50.342676 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-147f41b5-629f-46b6-a5a1-240a0d1772a1 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] [instance: 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:50.355811 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-9560f240-2844-4256-bf55-a61406a155bc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:50.356912 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-147f41b5-629f-46b6-a5a1-240a0d1772a1 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:50.357414 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-147f41b5-629f-46b6-a5a1-240a0d1772a1 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:50.358245 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-147f41b5-629f-46b6-a5a1-240a0d1772a1 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:50.358684 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-147f41b5-629f-46b6-a5a1-240a0d1772a1 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:50.364161 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-9560f240-2844-4256-bf55-a61406a155bc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.307549 Feb 03 02:57:50.365115 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 132/268] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:50 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:50.529747 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-147f41b5-629f-46b6-a5a1-240a0d1772a1 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc8b34ea6540d3991b23a58f729736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b005a4be7b40aab2f79fc959cd6549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:50.537935 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-147f41b5-629f-46b6-a5a1-240a0d1772a1 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] 10.222.0.31 "GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49" status: 200 len: 1470 microversion: 2.1 time: 0.200029 Feb 03 02:57:50.539872 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 137/269] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:50 2022] GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49 => generated 1470 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:50.603645 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-6984c0d9-e3a1-4f9b-993b-fa5669f6e440 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:50.604315 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-6984c0d9-e3a1-4f9b-993b-fa5669f6e440 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 543ff03e-fd92-42d9-8121-5aa22a1bd45d] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:50.611402 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6984c0d9-e3a1-4f9b-993b-fa5669f6e440 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:50.611857 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6984c0d9-e3a1-4f9b-993b-fa5669f6e440 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:50.615130 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6984c0d9-e3a1-4f9b-993b-fa5669f6e440 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:50.615617 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6984c0d9-e3a1-4f9b-993b-fa5669f6e440 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:50.801191 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-6984c0d9-e3a1-4f9b-993b-fa5669f6e440 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:50.810464 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-6984c0d9-e3a1-4f9b-993b-fa5669f6e440 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d" status: 200 len: 1318 microversion: 2.1 time: 0.211110 Feb 03 02:57:50.811583 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 133/270] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:50 2022] GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:50.883248 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-09dddaa4-07a5-451c-b406-ed747789a93f tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:50.883844 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-09dddaa4-07a5-451c-b406-ed747789a93f tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:50.890346 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-09dddaa4-07a5-451c-b406-ed747789a93f tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:50.890774 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-09dddaa4-07a5-451c-b406-ed747789a93f tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:50.891747 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-09dddaa4-07a5-451c-b406-ed747789a93f tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:50.892170 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-09dddaa4-07a5-451c-b406-ed747789a93f tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:51.210828 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-09dddaa4-07a5-451c-b406-ed747789a93f tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:51.222431 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-09dddaa4-07a5-451c-b406-ed747789a93f tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1553 microversion: 2.1 time: 0.342770 Feb 03 02:57:51.223287 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 138/271] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:50 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1553 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:51.283580 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-0415ae25-c23d-44bf-bfd9-4a55e229d1ec tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:51.284429 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-0415ae25-c23d-44bf-bfd9-4a55e229d1ec tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:51.293743 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0415ae25-c23d-44bf-bfd9-4a55e229d1ec tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:51.294473 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0415ae25-c23d-44bf-bfd9-4a55e229d1ec tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:51.297655 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0415ae25-c23d-44bf-bfd9-4a55e229d1ec tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:51.298109 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0415ae25-c23d-44bf-bfd9-4a55e229d1ec tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:51.380944 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-6d349c74-1c3e-4c46-a149-e387b047d3e9 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:51.381547 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-6d349c74-1c3e-4c46-a149-e387b047d3e9 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:51.394930 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6d349c74-1c3e-4c46-a149-e387b047d3e9 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:51.395615 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6d349c74-1c3e-4c46-a149-e387b047d3e9 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:51.396539 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6d349c74-1c3e-4c46-a149-e387b047d3e9 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:51.398515 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6d349c74-1c3e-4c46-a149-e387b047d3e9 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:51.707213 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-0415ae25-c23d-44bf-bfd9-4a55e229d1ec tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:51.717255 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-0415ae25-c23d-44bf-bfd9-4a55e229d1ec tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c" status: 200 len: 1503 microversion: 2.1 time: 0.437654 Feb 03 02:57:51.718117 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 134/272] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:51 2022] GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c => generated 1503 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:51.724388 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-30146e7d-ee3a-4430-9319-4baee453fcf2 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:51.725097 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-30146e7d-ee3a-4430-9319-4baee453fcf2 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] [instance: 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:51.734430 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-30146e7d-ee3a-4430-9319-4baee453fcf2 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:51.735075 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-30146e7d-ee3a-4430-9319-4baee453fcf2 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:51.736027 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-30146e7d-ee3a-4430-9319-4baee453fcf2 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:51.736605 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-30146e7d-ee3a-4430-9319-4baee453fcf2 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:51.816291 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-6d349c74-1c3e-4c46-a149-e387b047d3e9 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:51.830426 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-6d349c74-1c3e-4c46-a149-e387b047d3e9 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.453599 Feb 03 02:57:51.831097 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 139/273] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:51 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:51.854653 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-da8cdd9c-334e-42a4-8b17-b57038abf458 req-a5039889-12ab-41fc-9f83-2478a50b18f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "543ff03e-fd92-42d9-8121-5aa22a1bd45d", "name": "network-vif-plugged", "status": "completed", "tag": "65f4c02d-138c-4fb0-aae2-8b37b8e7ee12"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:57:51.862305 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:57:51.862305 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 02:57:51.875132 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-da8cdd9c-334e-42a4-8b17-b57038abf458 req-a5039889-12ab-41fc-9f83-2478a50b18f7 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:51.876029 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-da8cdd9c-334e-42a4-8b17-b57038abf458 req-a5039889-12ab-41fc-9f83-2478a50b18f7 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:51.912641 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-da8cdd9c-334e-42a4-8b17-b57038abf458 req-a5039889-12ab-41fc-9f83-2478a50b18f7 service nova] Creating event network-vif-plugged:65f4c02d-138c-4fb0-aae2-8b37b8e7ee12 for instance 543ff03e-fd92-42d9-8121-5aa22a1bd45d on hv-cinder-82758 Feb 03 02:57:51.921547 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-da8cdd9c-334e-42a4-8b17-b57038abf458 req-a5039889-12ab-41fc-9f83-2478a50b18f7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079178 Feb 03 02:57:51.922668 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 140/274] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:57:51.929523 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-5b32d41a-4b0c-47b3-84fe-408b5432deb0 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:51.930595 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-5b32d41a-4b0c-47b3-84fe-408b5432deb0 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 543ff03e-fd92-42d9-8121-5aa22a1bd45d] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:51.942693 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5b32d41a-4b0c-47b3-84fe-408b5432deb0 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:51.943681 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5b32d41a-4b0c-47b3-84fe-408b5432deb0 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:51.944671 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5b32d41a-4b0c-47b3-84fe-408b5432deb0 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:51.945268 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5b32d41a-4b0c-47b3-84fe-408b5432deb0 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:52.141530 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-30146e7d-ee3a-4430-9319-4baee453fcf2 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc8b34ea6540d3991b23a58f729736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b005a4be7b40aab2f79fc959cd6549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:52.161695 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-30146e7d-ee3a-4430-9319-4baee453fcf2 tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] 10.222.0.31 "GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49" status: 200 len: 1470 microversion: 2.1 time: 0.441957 Feb 03 02:57:52.162628 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 135/275] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:51 2022] GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49 => generated 1470 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:52.176885 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-2bcc183e-1f39-4345-bcda-3f48538e2c69 req-971b1b0c-328d-467d-ad01-148a3759077a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdafd7ae-560d-4c7a-848e-eb8506ffba4c", "name": "network-vif-deleted", "tag": "8eb17e7f-c7af-449c-8842-be520b097cba"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:57:52.178518 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:57:52.178518 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 02:57:52.192077 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-2bcc183e-1f39-4345-bcda-3f48538e2c69 req-971b1b0c-328d-467d-ad01-148a3759077a service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:52.192519 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-2bcc183e-1f39-4345-bcda-3f48538e2c69 req-971b1b0c-328d-467d-ad01-148a3759077a service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:52.225682 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-2bcc183e-1f39-4345-bcda-3f48538e2c69 req-971b1b0c-328d-467d-ad01-148a3759077a service nova] Creating event network-vif-deleted:8eb17e7f-c7af-449c-8842-be520b097cba for instance bdafd7ae-560d-4c7a-848e-eb8506ffba4c on hv-cinder-82758 Feb 03 02:57:52.241795 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-2bcc183e-1f39-4345-bcda-3f48538e2c69 req-971b1b0c-328d-467d-ad01-148a3759077a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077870 Feb 03 02:57:52.244335 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 136/276] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:57:52.246321 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-5b32d41a-4b0c-47b3-84fe-408b5432deb0 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:52.250984 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-c753796a-4945-4d85-af1e-57fbf5c1cec3 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:52.251790 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-c753796a-4945-4d85-af1e-57fbf5c1cec3 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:52.253832 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-5b32d41a-4b0c-47b3-84fe-408b5432deb0 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d" status: 200 len: 1318 microversion: 2.1 time: 0.329775 Feb 03 02:57:52.254398 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 141/277] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:51 2022] GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d => generated 1318 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:52.268268 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c753796a-4945-4d85-af1e-57fbf5c1cec3 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:52.269167 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c753796a-4945-4d85-af1e-57fbf5c1cec3 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:52.270580 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c753796a-4945-4d85-af1e-57fbf5c1cec3 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:52.271203 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c753796a-4945-4d85-af1e-57fbf5c1cec3 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:52.443423 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-c753796a-4945-4d85-af1e-57fbf5c1cec3 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:52.455476 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-c753796a-4945-4d85-af1e-57fbf5c1cec3 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1553 microversion: 2.1 time: 0.209281 Feb 03 02:57:52.456595 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 137/278] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:52 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1553 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:52.731788 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-f152a4c1-f9e3-48f2-8700-15f757daf03b req-03528cfe-aea2-4c13-a766-9bd700c51201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49", "name": "network-vif-deleted", "tag": "2da89c94-dd76-4f49-8a5b-207f79792eaf"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:57:52.733445 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:57:52.733445 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 02:57:52.734543 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-43053e65-26ad-4c1e-ad84-c9d1ff5a6f06 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:52.735320 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-43053e65-26ad-4c1e-ad84-c9d1ff5a6f06 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:52.741877 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-f152a4c1-f9e3-48f2-8700-15f757daf03b req-03528cfe-aea2-4c13-a766-9bd700c51201 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:52.742556 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-f152a4c1-f9e3-48f2-8700-15f757daf03b req-03528cfe-aea2-4c13-a766-9bd700c51201 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:52.743883 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-43053e65-26ad-4c1e-ad84-c9d1ff5a6f06 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:52.744326 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-43053e65-26ad-4c1e-ad84-c9d1ff5a6f06 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:52.745131 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-43053e65-26ad-4c1e-ad84-c9d1ff5a6f06 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:52.746857 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-43053e65-26ad-4c1e-ad84-c9d1ff5a6f06 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:52.759015 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-f152a4c1-f9e3-48f2-8700-15f757daf03b req-03528cfe-aea2-4c13-a766-9bd700c51201 service nova] Creating event network-vif-deleted:2da89c94-dd76-4f49-8a5b-207f79792eaf for instance 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49 on hv-cinder-82758 Feb 03 02:57:52.766352 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-f152a4c1-f9e3-48f2-8700-15f757daf03b req-03528cfe-aea2-4c13-a766-9bd700c51201 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038401 Feb 03 02:57:52.767634 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 142/279] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:57:52.784754 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-43053e65-26ad-4c1e-ad84-c9d1ff5a6f06 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:52.785382 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-43053e65-26ad-4c1e-ad84-c9d1ff5a6f06 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:52.785862 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.objects.instance [None req-43053e65-26ad-4c1e-ad84-c9d1ff5a6f06 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lazy-loading 'fault' on Instance uuid bdafd7ae-560d-4c7a-848e-eb8506ffba4c {{(pid=116385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 03 02:57:52.843805 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-43053e65-26ad-4c1e-ad84-c9d1ff5a6f06 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:52.852171 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-43053e65-26ad-4c1e-ad84-c9d1ff5a6f06 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c" status: 200 len: 1303 microversion: 2.1 time: 0.121145 Feb 03 02:57:52.852793 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 138/280] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:52 2022] GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c => generated 1303 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:52.853326 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-c58c4964-a4b3-4d23-b8e7-1e874358f20e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:52.854478 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-c58c4964-a4b3-4d23-b8e7-1e874358f20e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:52.863191 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c58c4964-a4b3-4d23-b8e7-1e874358f20e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:52.863663 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c58c4964-a4b3-4d23-b8e7-1e874358f20e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:52.864645 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c58c4964-a4b3-4d23-b8e7-1e874358f20e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:52.865111 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c58c4964-a4b3-4d23-b8e7-1e874358f20e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:53.007381 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-c58c4964-a4b3-4d23-b8e7-1e874358f20e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:53.015784 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-c58c4964-a4b3-4d23-b8e7-1e874358f20e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.171662 Feb 03 02:57:53.017148 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 143/281] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:52 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:53.179143 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-7e38f967-d0fb-4904-9c3d-ceee1570c48b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:53.180133 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-7e38f967-d0fb-4904-9c3d-ceee1570c48b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] [instance: 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:53.186728 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7e38f967-d0fb-4904-9c3d-ceee1570c48b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:53.191626 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7e38f967-d0fb-4904-9c3d-ceee1570c48b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:53.192437 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7e38f967-d0fb-4904-9c3d-ceee1570c48b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:53.192922 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7e38f967-d0fb-4904-9c3d-ceee1570c48b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:53.243803 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7e38f967-d0fb-4904-9c3d-ceee1570c48b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:53.244250 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7e38f967-d0fb-4904-9c3d-ceee1570c48b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:53.244700 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.objects.instance [None req-7e38f967-d0fb-4904-9c3d-ceee1570c48b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lazy-loading 'fault' on Instance uuid 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49 {{(pid=116385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 03 02:57:53.271015 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-2dc249b5-8147-4d46-bd88-302f929058bb tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:53.271612 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-2dc249b5-8147-4d46-bd88-302f929058bb tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 543ff03e-fd92-42d9-8121-5aa22a1bd45d] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:53.278977 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2dc249b5-8147-4d46-bd88-302f929058bb tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:53.279651 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2dc249b5-8147-4d46-bd88-302f929058bb tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:53.286793 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2dc249b5-8147-4d46-bd88-302f929058bb tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:53.286793 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2dc249b5-8147-4d46-bd88-302f929058bb tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:53.294709 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-7e38f967-d0fb-4904-9c3d-ceee1570c48b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'befc8b34ea6540d3991b23a58f729736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32b005a4be7b40aab2f79fc959cd6549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:53.302234 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-7e38f967-d0fb-4904-9c3d-ceee1570c48b tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] 10.222.0.31 "GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49" status: 200 len: 1304 microversion: 2.1 time: 0.127032 Feb 03 02:57:53.302794 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 139/282] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:53 2022] GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49 => generated 1304 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:53.438359 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-2dc249b5-8147-4d46-bd88-302f929058bb tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:53.447266 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-2dc249b5-8147-4d46-bd88-302f929058bb tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d" status: 200 len: 1318 microversion: 2.1 time: 0.179982 Feb 03 02:57:53.448264 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 144/283] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:53 2022] GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:53.473116 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-29f8f338-b3d8-4d18-a4a4-9c446ec2eccc tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:53.473810 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-29f8f338-b3d8-4d18-a4a4-9c446ec2eccc tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:53.482100 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-29f8f338-b3d8-4d18-a4a4-9c446ec2eccc tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:53.482550 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-29f8f338-b3d8-4d18-a4a4-9c446ec2eccc tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:53.483328 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-29f8f338-b3d8-4d18-a4a4-9c446ec2eccc tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:53.483753 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-29f8f338-b3d8-4d18-a4a4-9c446ec2eccc tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:53.553398 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-29f8f338-b3d8-4d18-a4a4-9c446ec2eccc tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b69c633ad9a496f924f8f2479eea06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f534df59e149f8b14cd7406f932b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:53.561352 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-29f8f338-b3d8-4d18-a4a4-9c446ec2eccc tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 200 len: 1345 microversion: 2.1 time: 0.092023 Feb 03 02:57:53.561920 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 140/284] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:53 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 1345 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:53.871298 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-67d0baab-4479-429a-9a2d-d7f96174889f tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:53.872032 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-67d0baab-4479-429a-9a2d-d7f96174889f tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: bdafd7ae-560d-4c7a-848e-eb8506ffba4c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:53.878974 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-67d0baab-4479-429a-9a2d-d7f96174889f tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:53.879421 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-67d0baab-4479-429a-9a2d-d7f96174889f tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:53.880200 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-67d0baab-4479-429a-9a2d-d7f96174889f tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:53.880627 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-67d0baab-4479-429a-9a2d-d7f96174889f tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:53.894973 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.wsgi [None req-67d0baab-4479-429a-9a2d-d7f96174889f tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] HTTP exception thrown: Instance bdafd7ae-560d-4c7a-848e-eb8506ffba4c could not be found. Feb 03 02:57:53.895568 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-67d0baab-4479-429a-9a2d-d7f96174889f tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Returning 404 to user: Instance bdafd7ae-560d-4c7a-848e-eb8506ffba4c could not be found. {{(pid=116386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 02:57:53.896395 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-67d0baab-4479-429a-9a2d-d7f96174889f tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c" status: 404 len: 111 microversion: 2.1 time: 0.029615 Feb 03 02:57:53.897941 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 145/285] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:53 2022] GET /compute/v2.1/servers/bdafd7ae-560d-4c7a-848e-eb8506ffba4c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 02:57:54.026295 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-eeb5a472-103f-4947-94fe-696f5f2f33f1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-729083928", "imageRef": "99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce", "flavorRef": "452", "networks": [{"uuid": "22fe169f-e273-4ced-9b97-e4e9b084e012"}]}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:57:54.033577 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-908d024f-1cec-43d3-bfad-35a7ca128872 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:54.034984 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-908d024f-1cec-43d3-bfad-35a7ca128872 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:54.043269 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-908d024f-1cec-43d3-bfad-35a7ca128872 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:54.043903 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-908d024f-1cec-43d3-bfad-35a7ca128872 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:54.044869 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-908d024f-1cec-43d3-bfad-35a7ca128872 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:54.045437 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-908d024f-1cec-43d3-bfad-35a7ca128872 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:54.085833 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.network.neutron [None req-eeb5a472-103f-4947-94fe-696f5f2f33f1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] validate_networks() for [('22fe169f-e273-4ced-9b97-e4e9b084e012', None, None, None, None, None)] {{(pid=116385) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 03 02:57:54.286763 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-908d024f-1cec-43d3-bfad-35a7ca128872 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:54.294691 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-908d024f-1cec-43d3-bfad-35a7ca128872 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.264773 Feb 03 02:57:54.295599 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 146/286] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:54 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:54.319726 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-8b0d55ec-5e26-4dc5-b18e-79c657c944cd tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:54.320685 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-8b0d55ec-5e26-4dc5-b18e-79c657c944cd tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] [instance: 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:54.327244 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8b0d55ec-5e26-4dc5-b18e-79c657c944cd tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:54.327758 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8b0d55ec-5e26-4dc5-b18e-79c657c944cd tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:54.328667 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8b0d55ec-5e26-4dc5-b18e-79c657c944cd tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:54.329284 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8b0d55ec-5e26-4dc5-b18e-79c657c944cd tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:54.344333 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.wsgi [None req-8b0d55ec-5e26-4dc5-b18e-79c657c944cd tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] HTTP exception thrown: Instance 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49 could not be found. Feb 03 02:57:54.345215 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-8b0d55ec-5e26-4dc5-b18e-79c657c944cd tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] Returning 404 to user: Instance 9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49 could not be found. {{(pid=116386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 02:57:54.346180 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-8b0d55ec-5e26-4dc5-b18e-79c657c944cd tempest-VolumesNegativeTest-1722663569 tempest-VolumesNegativeTest-1722663569-project] 10.222.0.31 "GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49" status: 404 len: 111 microversion: 2.1 time: 0.030365 Feb 03 02:57:54.347052 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 147/287] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:54 2022] GET /compute/v2.1/servers/9fcdcd70-2aa6-4bd6-bf26-d7c7e0b47a49 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 02:57:54.464502 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-665e7e21-2feb-4906-b950-571d7bac2645 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:54.464710 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-665e7e21-2feb-4906-b950-571d7bac2645 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 543ff03e-fd92-42d9-8121-5aa22a1bd45d] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:54.470541 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-665e7e21-2feb-4906-b950-571d7bac2645 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:54.471185 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-665e7e21-2feb-4906-b950-571d7bac2645 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:54.472010 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-665e7e21-2feb-4906-b950-571d7bac2645 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:54.472445 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-665e7e21-2feb-4906-b950-571d7bac2645 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:54.507954 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-eeb5a472-103f-4947-94fe-696f5f2f33f1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Flavor limits 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 03 02:57:54.508473 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-eeb5a472-103f-4947-94fe-696f5f2f33f1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Image limits 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 03 02:57:54.508875 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-eeb5a472-103f-4947-94fe-696f5f2f33f1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Flavor pref 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 03 02:57:54.509344 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-eeb5a472-103f-4947-94fe-696f5f2f33f1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Image pref 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 03 02:57:54.509775 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-eeb5a472-103f-4947-94fe-696f5f2f33f1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 03 02:57:54.519040 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-eeb5a472-103f-4947-94fe-696f5f2f33f1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:54.519483 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-eeb5a472-103f-4947-94fe-696f5f2f33f1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:54.520283 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-eeb5a472-103f-4947-94fe-696f5f2f33f1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:54.520749 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-eeb5a472-103f-4947-94fe-696f5f2f33f1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:54.537241 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-eeb5a472-103f-4947-94fe-696f5f2f33f1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Getting quotas for project 15c4256dc55e466d95808fa66f72c37d. Resources: {'cores', 'ram', 'instances'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 02:57:54.542672 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-eeb5a472-103f-4947-94fe-696f5f2f33f1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Getting quotas for user 3754bf46af13470faf170277d5086e88 and project 15c4256dc55e466d95808fa66f72c37d. Resources: {'cores', 'ram', 'instances'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 02:57:54.555039 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-eeb5a472-103f-4947-94fe-696f5f2f33f1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Going to run 1 instances... {{(pid=116385) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 03 02:57:54.557665 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-eeb5a472-103f-4947-94fe-696f5f2f33f1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: 04dd696f-26bd-4f5f-957d-797a7c6aab92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 03 02:57:54.608553 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-eeb5a472-103f-4947-94fe-696f5f2f33f1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585586 Feb 03 02:57:54.609597 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 141/288] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Feb 3 02:57:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 03 02:57:54.614376 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-ac34a707-83f4-4955-9e1d-1afa4923b99e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:54.615180 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-ac34a707-83f4-4955-9e1d-1afa4923b99e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:54.625483 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ac34a707-83f4-4955-9e1d-1afa4923b99e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:54.625731 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-665e7e21-2feb-4906-b950-571d7bac2645 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:54.626752 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ac34a707-83f4-4955-9e1d-1afa4923b99e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:54.627995 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ac34a707-83f4-4955-9e1d-1afa4923b99e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:54.629044 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ac34a707-83f4-4955-9e1d-1afa4923b99e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:54.636050 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-665e7e21-2feb-4906-b950-571d7bac2645 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d" status: 200 len: 1509 microversion: 2.1 time: 0.175472 Feb 03 02:57:54.651303 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.wsgi [None req-ac34a707-83f4-4955-9e1d-1afa4923b99e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] HTTP exception thrown: Instance 34add2e5-8d7d-42c6-8f4c-e7a60fb27183 could not be found. Feb 03 02:57:54.652033 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-ac34a707-83f4-4955-9e1d-1afa4923b99e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Returning 404 to user: Instance 34add2e5-8d7d-42c6-8f4c-e7a60fb27183 could not be found. {{(pid=116385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 02:57:54.652996 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-ac34a707-83f4-4955-9e1d-1afa4923b99e tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 404 len: 111 microversion: 2.1 time: 0.042364 Feb 03 02:57:54.653324 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 148/289] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:54 2022] GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d => generated 1509 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:54.653815 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 142/290] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:54 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 02:57:54.662881 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-805ceb42-315c-4917-a279-f90cf211163e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e3d52b1-233a-428d-ac48-1a8f27f13174"}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:57:54.664686 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-805ceb42-315c-4917-a279-f90cf211163e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 543ff03e-fd92-42d9-8121-5aa22a1bd45d] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:54.672419 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-805ceb42-315c-4917-a279-f90cf211163e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:54.673001 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-805ceb42-315c-4917-a279-f90cf211163e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:54.673891 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-805ceb42-315c-4917-a279-f90cf211163e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:54.674554 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-805ceb42-315c-4917-a279-f90cf211163e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:54.682539 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-f71092dc-3bcb-4f7e-9c62-ae42ec1b66e9 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:54.688461 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-f71092dc-3bcb-4f7e-9c62-ae42ec1b66e9 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: 04dd696f-26bd-4f5f-957d-797a7c6aab92] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:54.806037 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-f71092dc-3bcb-4f7e-9c62-ae42ec1b66e9 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:54.814579 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-f71092dc-3bcb-4f7e-9c62-ae42ec1b66e9 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92" status: 200 len: 1213 microversion: 2.1 time: 0.155557 Feb 03 02:57:54.815238 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 149/291] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:54 2022] GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92 => generated 1213 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:54.827111 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-55bc1740-3902-4780-98c3-fa0c5447a93c req-9424f418-ec30-4650-97bc-9aff281c4d3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34add2e5-8d7d-42c6-8f4c-e7a60fb27183", "name": "network-vif-deleted", "tag": "4f976c37-c124-473b-94e5-f47a2ad3d40b"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:57:54.829209 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:57:54.829209 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 02:57:54.841864 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.wsgi [None req-805ceb42-315c-4917-a279-f90cf211163e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] HTTP exception thrown: Invalid volume: volume 8e3d52b1-233a-428d-ac48-1a8f27f13174 is already attached to instances: 933b2272-897b-43bc-8ba0-252edeef0170 Feb 03 02:57:54.842464 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-805ceb42-315c-4917-a279-f90cf211163e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Returning 400 to user: Invalid volume: volume 8e3d52b1-233a-428d-ac48-1a8f27f13174 is already attached to instances: 933b2272-897b-43bc-8ba0-252edeef0170 {{(pid=116385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 02:57:54.843304 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-805ceb42-315c-4917-a279-f90cf211163e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "POST /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.185851 Feb 03 02:57:54.844218 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 143/292] 10.222.0.31 () {60 vars in 1322 bytes} [Thu Feb 3 02:57:54 2022] POST /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d/os-volume_attachments => generated 174 bytes in 187 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 03 02:57:54.857061 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-55bc1740-3902-4780-98c3-fa0c5447a93c req-9424f418-ec30-4650-97bc-9aff281c4d3a service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:54.858041 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-55bc1740-3902-4780-98c3-fa0c5447a93c req-9424f418-ec30-4650-97bc-9aff281c4d3a service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:54.885434 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-55bc1740-3902-4780-98c3-fa0c5447a93c req-9424f418-ec30-4650-97bc-9aff281c4d3a service nova] Creating event network-vif-deleted:4f976c37-c124-473b-94e5-f47a2ad3d40b for instance 34add2e5-8d7d-42c6-8f4c-e7a60fb27183 on hv-cinder-82758 Feb 03 02:57:54.889487 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-bda60793-56b1-4bed-be91-227162ca9ef4 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:54.890410 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-bda60793-56b1-4bed-be91-227162ca9ef4 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:54.893335 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-55bc1740-3902-4780-98c3-fa0c5447a93c req-9424f418-ec30-4650-97bc-9aff281c4d3a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075505 Feb 03 02:57:54.893972 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 150/293] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:57:54.902269 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bda60793-56b1-4bed-be91-227162ca9ef4 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:54.902736 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bda60793-56b1-4bed-be91-227162ca9ef4 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:54.903677 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bda60793-56b1-4bed-be91-227162ca9ef4 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:54.904155 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bda60793-56b1-4bed-be91-227162ca9ef4 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:54.921936 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.wsgi [None req-bda60793-56b1-4bed-be91-227162ca9ef4 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] HTTP exception thrown: Instance 34add2e5-8d7d-42c6-8f4c-e7a60fb27183 could not be found. Feb 03 02:57:54.923018 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-bda60793-56b1-4bed-be91-227162ca9ef4 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Returning 404 to user: Instance 34add2e5-8d7d-42c6-8f4c-e7a60fb27183 could not be found. {{(pid=116385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 02:57:54.924056 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-bda60793-56b1-4bed-be91-227162ca9ef4 tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038803 Feb 03 02:57:54.924770 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 144/294] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Feb 3 02:57:54 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 03 02:57:54.958335 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-c8132b93-903b-4c17-8ada-01ec4c73dbd8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:54.958918 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-c8132b93-903b-4c17-8ada-01ec4c73dbd8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:54.974963 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c8132b93-903b-4c17-8ada-01ec4c73dbd8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:54.974963 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c8132b93-903b-4c17-8ada-01ec4c73dbd8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:54.975550 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c8132b93-903b-4c17-8ada-01ec4c73dbd8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:54.977130 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c8132b93-903b-4c17-8ada-01ec4c73dbd8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:55.225081 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.objects.instance [None req-c8132b93-903b-4c17-8ada-01ec4c73dbd8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lazy-loading 'services' on Instance uuid 933b2272-897b-43bc-8ba0-252edeef0170 {{(pid=116386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 03 02:57:55.311738 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-d20d1704-5bdc-4465-b393-a149bb3bef58 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:55.312774 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-d20d1704-5bdc-4465-b393-a149bb3bef58 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:55.334928 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d20d1704-5bdc-4465-b393-a149bb3bef58 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:55.335346 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d20d1704-5bdc-4465-b393-a149bb3bef58 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:55.336209 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d20d1704-5bdc-4465-b393-a149bb3bef58 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:55.336929 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d20d1704-5bdc-4465-b393-a149bb3bef58 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:55.410418 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-c8132b93-903b-4c17-8ada-01ec4c73dbd8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "DELETE /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170/os-volume_attachments/8e3d52b1-233a-428d-ac48-1a8f27f13174" status: 202 len: 0 microversion: 2.1 time: 0.455526 Feb 03 02:57:55.413900 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 151/295] 10.222.0.31 () {58 vars in 1415 bytes} [Thu Feb 3 02:57:54 2022] DELETE /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170/os-volume_attachments/8e3d52b1-233a-428d-ac48-1a8f27f13174 => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 03 02:57:55.436930 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-12146b17-78d1-4954-ab94-4792f8cfd73f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:55.439044 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-12146b17-78d1-4954-ab94-4792f8cfd73f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:55.452561 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-12146b17-78d1-4954-ab94-4792f8cfd73f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:55.453323 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-12146b17-78d1-4954-ab94-4792f8cfd73f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:55.454405 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-12146b17-78d1-4954-ab94-4792f8cfd73f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:55.455131 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-12146b17-78d1-4954-ab94-4792f8cfd73f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:55.512841 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-12146b17-78d1-4954-ab94-4792f8cfd73f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091823 Feb 03 02:57:55.513488 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 152/296] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Feb 3 02:57:55 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:57:55.591921 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-d20d1704-5bdc-4465-b393-a149bb3bef58 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:55.602222 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-d20d1704-5bdc-4465-b393-a149bb3bef58 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.294032 Feb 03 02:57:55.602871 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 145/297] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:55 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:55.831499 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-68d681ec-2cfb-43d1-995e-c8ba2592075e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:55.832478 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-68d681ec-2cfb-43d1-995e-c8ba2592075e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: 04dd696f-26bd-4f5f-957d-797a7c6aab92] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:55.839010 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-68d681ec-2cfb-43d1-995e-c8ba2592075e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:55.839450 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-68d681ec-2cfb-43d1-995e-c8ba2592075e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:55.840247 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-68d681ec-2cfb-43d1-995e-c8ba2592075e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:55.840873 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-68d681ec-2cfb-43d1-995e-c8ba2592075e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:55.914221 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-68d681ec-2cfb-43d1-995e-c8ba2592075e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:55.923592 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-68d681ec-2cfb-43d1-995e-c8ba2592075e tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92" status: 200 len: 1265 microversion: 2.1 time: 0.095770 Feb 03 02:57:55.924178 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 153/298] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:55 2022] GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92 => generated 1265 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:56.266077 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-f62c9a69-a21c-4223-b760-b70836076bcf tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:56.266756 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-f62c9a69-a21c-4223-b760-b70836076bcf tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:56.276007 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f62c9a69-a21c-4223-b760-b70836076bcf tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:56.277807 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f62c9a69-a21c-4223-b760-b70836076bcf tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:56.282656 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f62c9a69-a21c-4223-b760-b70836076bcf tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:56.283105 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f62c9a69-a21c-4223-b760-b70836076bcf tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:56.303821 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.wsgi [None req-f62c9a69-a21c-4223-b760-b70836076bcf tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] HTTP exception thrown: Instance 34add2e5-8d7d-42c6-8f4c-e7a60fb27183 could not be found. Feb 03 02:57:56.304459 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-f62c9a69-a21c-4223-b760-b70836076bcf tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Returning 404 to user: Instance 34add2e5-8d7d-42c6-8f4c-e7a60fb27183 could not be found. {{(pid=116385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 02:57:56.305454 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-f62c9a69-a21c-4223-b760-b70836076bcf tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "DELETE /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 404 len: 111 microversion: 2.1 time: 0.043369 Feb 03 02:57:56.306060 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 146/299] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Feb 3 02:57:56 2022] DELETE /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 03 02:57:56.316542 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-2240a64b-d211-4711-b2f2-7c75e5e289cd tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:56.317567 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-2240a64b-d211-4711-b2f2-7c75e5e289cd tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] [instance: 34add2e5-8d7d-42c6-8f4c-e7a60fb27183] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:56.324380 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2240a64b-d211-4711-b2f2-7c75e5e289cd tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:56.324956 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2240a64b-d211-4711-b2f2-7c75e5e289cd tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:56.325824 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2240a64b-d211-4711-b2f2-7c75e5e289cd tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:56.326255 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2240a64b-d211-4711-b2f2-7c75e5e289cd tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:56.344974 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.wsgi [None req-2240a64b-d211-4711-b2f2-7c75e5e289cd tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] HTTP exception thrown: Instance 34add2e5-8d7d-42c6-8f4c-e7a60fb27183 could not be found. Feb 03 02:57:56.345864 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-2240a64b-d211-4711-b2f2-7c75e5e289cd tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] Returning 404 to user: Instance 34add2e5-8d7d-42c6-8f4c-e7a60fb27183 could not be found. {{(pid=116386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 02:57:56.346926 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-2240a64b-d211-4711-b2f2-7c75e5e289cd tempest-DeleteServersTestJSON-289698609 tempest-DeleteServersTestJSON-289698609-project] 10.222.0.31 "GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183" status: 404 len: 111 microversion: 2.1 time: 0.036463 Feb 03 02:57:56.351605 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 154/300] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:56 2022] GET /compute/v2.1/servers/34add2e5-8d7d-42c6-8f4c-e7a60fb27183 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 02:57:56.526566 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-dab97c3e-c52a-45c6-b1b3-015ec39aaac3 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:56.527500 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-dab97c3e-c52a-45c6-b1b3-015ec39aaac3 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:56.539130 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-dab97c3e-c52a-45c6-b1b3-015ec39aaac3 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:56.539615 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-dab97c3e-c52a-45c6-b1b3-015ec39aaac3 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:56.540345 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-dab97c3e-c52a-45c6-b1b3-015ec39aaac3 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:56.540789 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-dab97c3e-c52a-45c6-b1b3-015ec39aaac3 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:56.621032 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-dab97c3e-c52a-45c6-b1b3-015ec39aaac3 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.099226 Feb 03 02:57:56.623050 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 147/301] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Feb 3 02:57:56 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 03 02:57:56.629389 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-d5699e8c-5daa-404d-ba84-179ca7f2cd1f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:56.630004 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-d5699e8c-5daa-404d-ba84-179ca7f2cd1f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:56.638764 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d5699e8c-5daa-404d-ba84-179ca7f2cd1f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:56.640776 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d5699e8c-5daa-404d-ba84-179ca7f2cd1f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:56.642792 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d5699e8c-5daa-404d-ba84-179ca7f2cd1f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:56.645376 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d5699e8c-5daa-404d-ba84-179ca7f2cd1f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:56.942853 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-d5699e8c-5daa-404d-ba84-179ca7f2cd1f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:56.946125 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-7ee42cb6-d0e1-4059-8494-d074dad767c5 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:56.946899 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-7ee42cb6-d0e1-4059-8494-d074dad767c5 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: 04dd696f-26bd-4f5f-957d-797a7c6aab92] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:56.965698 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-d5699e8c-5daa-404d-ba84-179ca7f2cd1f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.345027 Feb 03 02:57:56.966271 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7ee42cb6-d0e1-4059-8494-d074dad767c5 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:56.966717 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7ee42cb6-d0e1-4059-8494-d074dad767c5 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:56.967162 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 155/302] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:56 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:56.969085 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7ee42cb6-d0e1-4059-8494-d074dad767c5 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:56.969530 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7ee42cb6-d0e1-4059-8494-d074dad767c5 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:57.046281 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-7ee42cb6-d0e1-4059-8494-d074dad767c5 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:57.054388 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-7ee42cb6-d0e1-4059-8494-d074dad767c5 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92" status: 200 len: 1271 microversion: 2.1 time: 0.114810 Feb 03 02:57:57.055186 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 148/303] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:56 2022] GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92 => generated 1271 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:57:57.061507 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-12f6ab04-2483-4f2d-9ba0-4b6bf8c9f83a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-628661473", "imageRef": "99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce", "flavorRef": "452", "networks": [{"uuid": "126c5997-2080-4b93-9c71-959073b0550c"}]}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:57:57.138835 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.network.neutron [None req-12f6ab04-2483-4f2d-9ba0-4b6bf8c9f83a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] validate_networks() for [('126c5997-2080-4b93-9c71-959073b0550c', None, None, None, None, None)] {{(pid=116386) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 03 02:57:57.535756 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-12f6ab04-2483-4f2d-9ba0-4b6bf8c9f83a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Flavor limits 0:0:0 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 03 02:57:57.536755 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-12f6ab04-2483-4f2d-9ba0-4b6bf8c9f83a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Image limits 0:0:0 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 03 02:57:57.537428 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-12f6ab04-2483-4f2d-9ba0-4b6bf8c9f83a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Flavor pref 0:0:0 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 03 02:57:57.538061 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-12f6ab04-2483-4f2d-9ba0-4b6bf8c9f83a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Image pref 0:0:0 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 03 02:57:57.538672 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-12f6ab04-2483-4f2d-9ba0-4b6bf8c9f83a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 03 02:57:57.548146 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-12f6ab04-2483-4f2d-9ba0-4b6bf8c9f83a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:57.548858 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-12f6ab04-2483-4f2d-9ba0-4b6bf8c9f83a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:57.549803 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-12f6ab04-2483-4f2d-9ba0-4b6bf8c9f83a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:57.550423 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-12f6ab04-2483-4f2d-9ba0-4b6bf8c9f83a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:57.568401 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.quota [None req-12f6ab04-2483-4f2d-9ba0-4b6bf8c9f83a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Getting quotas for project ff777728bb704feeabf264e753679daa. Resources: {'cores', 'ram', 'instances'} {{(pid=116386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 02:57:57.576014 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.quota [None req-12f6ab04-2483-4f2d-9ba0-4b6bf8c9f83a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Getting quotas for user 087b5f4f3891413b8b7fa727768c09a4 and project ff777728bb704feeabf264e753679daa. Resources: {'cores', 'ram', 'instances'} {{(pid=116386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 02:57:57.593465 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-12f6ab04-2483-4f2d-9ba0-4b6bf8c9f83a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Going to run 1 instances... {{(pid=116386) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 03 02:57:57.596805 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-12f6ab04-2483-4f2d-9ba0-4b6bf8c9f83a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 5db3a24e-6641-4f79-9d50-6b97b67ea6a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 03 02:57:57.649265 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-12f6ab04-2483-4f2d-9ba0-4b6bf8c9f83a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595643 Feb 03 02:57:57.650118 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 156/304] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Feb 3 02:57:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 03 02:57:57.661741 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-9a8c692d-d5fb-43ed-a38b-4d32ae275fd0 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:57.662344 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-9a8c692d-d5fb-43ed-a38b-4d32ae275fd0 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 5db3a24e-6641-4f79-9d50-6b97b67ea6a9] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:57.724938 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-9a8c692d-d5fb-43ed-a38b-4d32ae275fd0 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:57.733498 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-9a8c692d-d5fb-43ed-a38b-4d32ae275fd0 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9" status: 200 len: 1217 microversion: 2.1 time: 0.077158 Feb 03 02:57:57.734085 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 149/305] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:57 2022] GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9 => generated 1217 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:57.985419 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-f9bd9293-4905-48bc-9947-d337a69cad99 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:57.986265 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-f9bd9293-4905-48bc-9947-d337a69cad99 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:57.995251 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f9bd9293-4905-48bc-9947-d337a69cad99 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:57.996293 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f9bd9293-4905-48bc-9947-d337a69cad99 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:57.998087 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f9bd9293-4905-48bc-9947-d337a69cad99 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:57.998735 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f9bd9293-4905-48bc-9947-d337a69cad99 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:58.091336 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-236662e1-8187-475c-98cf-0b40c1758d8a tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:58.092306 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-236662e1-8187-475c-98cf-0b40c1758d8a tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: 04dd696f-26bd-4f5f-957d-797a7c6aab92] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:58.118430 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-236662e1-8187-475c-98cf-0b40c1758d8a tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:58.118871 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-236662e1-8187-475c-98cf-0b40c1758d8a tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:58.119680 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-236662e1-8187-475c-98cf-0b40c1758d8a tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:58.120111 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-236662e1-8187-475c-98cf-0b40c1758d8a tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:58.403034 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-f9bd9293-4905-48bc-9947-d337a69cad99 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:58.410698 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-f9bd9293-4905-48bc-9947-d337a69cad99 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.430119 Feb 03 02:57:58.420035 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 157/306] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:57 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:58.459091 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-236662e1-8187-475c-98cf-0b40c1758d8a tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:58.467152 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-236662e1-8187-475c-98cf-0b40c1758d8a tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92" status: 200 len: 1313 microversion: 2.1 time: 0.397728 Feb 03 02:57:58.471046 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 150/307] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:58 2022] GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92 => generated 1313 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:58.753186 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-c9a7004b-40ba-4a1e-9d07-fee6a2fe403e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:58.755718 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-c9a7004b-40ba-4a1e-9d07-fee6a2fe403e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 5db3a24e-6641-4f79-9d50-6b97b67ea6a9] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:58.766974 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c9a7004b-40ba-4a1e-9d07-fee6a2fe403e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:58.769323 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c9a7004b-40ba-4a1e-9d07-fee6a2fe403e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:58.770633 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c9a7004b-40ba-4a1e-9d07-fee6a2fe403e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:58.771254 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c9a7004b-40ba-4a1e-9d07-fee6a2fe403e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:58.855060 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-c9a7004b-40ba-4a1e-9d07-fee6a2fe403e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:57:58.866015 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-c9a7004b-40ba-4a1e-9d07-fee6a2fe403e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9" status: 200 len: 1269 microversion: 2.1 time: 0.118491 Feb 03 02:57:58.867096 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 158/308] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:58 2022] GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9 => generated 1269 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:57:59.045865 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-09d60655-7492-4ff9-afd7-2471265c1824 req-e22b1799-4770-49d2-915f-956ad471a6ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04dd696f-26bd-4f5f-957d-797a7c6aab92", "tag": "0ae06c2c-985a-4e0e-bf16-df148555be51"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:57:59.048236 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:57:59.048236 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 02:57:59.061987 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-09d60655-7492-4ff9-afd7-2471265c1824 req-e22b1799-4770-49d2-915f-956ad471a6ee service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:59.063388 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-09d60655-7492-4ff9-afd7-2471265c1824 req-e22b1799-4770-49d2-915f-956ad471a6ee service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:59.078746 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-09d60655-7492-4ff9-afd7-2471265c1824 req-e22b1799-4770-49d2-915f-956ad471a6ee service nova] Creating event network-changed:0ae06c2c-985a-4e0e-bf16-df148555be51 for instance 04dd696f-26bd-4f5f-957d-797a7c6aab92 on hv-cinder-82758 Feb 03 02:57:59.084807 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-09d60655-7492-4ff9-afd7-2471265c1824 req-e22b1799-4770-49d2-915f-956ad471a6ee service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042424 Feb 03 02:57:59.086257 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 151/309] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:57:59.433524 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-c04ded7b-74fc-48a5-a4f9-81d388f278c3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:59.434130 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-c04ded7b-74fc-48a5-a4f9-81d388f278c3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:59.451635 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c04ded7b-74fc-48a5-a4f9-81d388f278c3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:59.453252 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c04ded7b-74fc-48a5-a4f9-81d388f278c3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:59.456347 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c04ded7b-74fc-48a5-a4f9-81d388f278c3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:59.457711 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c04ded7b-74fc-48a5-a4f9-81d388f278c3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:59.493927 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-314de4d7-aae7-4b16-a62b-f9720982cdc9 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:57:59.498222 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-314de4d7-aae7-4b16-a62b-f9720982cdc9 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: 04dd696f-26bd-4f5f-957d-797a7c6aab92] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:57:59.525846 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-314de4d7-aae7-4b16-a62b-f9720982cdc9 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:59.528404 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-314de4d7-aae7-4b16-a62b-f9720982cdc9 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:57:59.529348 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-314de4d7-aae7-4b16-a62b-f9720982cdc9 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:57:59.529792 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-314de4d7-aae7-4b16-a62b-f9720982cdc9 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:00.013268 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-314de4d7-aae7-4b16-a62b-f9720982cdc9 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:00.020737 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-314de4d7-aae7-4b16-a62b-f9720982cdc9 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92" status: 200 len: 1313 microversion: 2.1 time: 0.538546 Feb 03 02:58:00.021312 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 152/310] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:59 2022] GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92 => generated 1313 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:00.038554 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-c04ded7b-74fc-48a5-a4f9-81d388f278c3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:00.042878 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-72f06f04-1fcb-4319-adb6-26ad7f2e872a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:00.043488 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-72f06f04-1fcb-4319-adb6-26ad7f2e872a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 5db3a24e-6641-4f79-9d50-6b97b67ea6a9] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:00.047512 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-c04ded7b-74fc-48a5-a4f9-81d388f278c3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.623425 Feb 03 02:58:00.053267 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-72f06f04-1fcb-4319-adb6-26ad7f2e872a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:00.056202 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-72f06f04-1fcb-4319-adb6-26ad7f2e872a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:00.057224 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-72f06f04-1fcb-4319-adb6-26ad7f2e872a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:00.057807 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-72f06f04-1fcb-4319-adb6-26ad7f2e872a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:00.059719 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 159/311] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:57:59 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:00.159724 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-72f06f04-1fcb-4319-adb6-26ad7f2e872a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:00.174084 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-72f06f04-1fcb-4319-adb6-26ad7f2e872a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9" status: 200 len: 1275 microversion: 2.1 time: 0.133808 Feb 03 02:58:00.175388 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 153/312] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:00 2022] GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9 => generated 1275 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:01.038237 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-5f94c215-fbf1-499f-bede-1a2c9570d565 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:01.039851 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-5f94c215-fbf1-499f-bede-1a2c9570d565 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: 04dd696f-26bd-4f5f-957d-797a7c6aab92] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:01.047756 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5f94c215-fbf1-499f-bede-1a2c9570d565 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:01.049416 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5f94c215-fbf1-499f-bede-1a2c9570d565 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:01.050898 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5f94c215-fbf1-499f-bede-1a2c9570d565 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:01.051735 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5f94c215-fbf1-499f-bede-1a2c9570d565 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:01.065404 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-9a5b2522-1536-4fb7-8da6-e289d86993c3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:01.066040 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-9a5b2522-1536-4fb7-8da6-e289d86993c3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:01.078823 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9a5b2522-1536-4fb7-8da6-e289d86993c3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:01.079521 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9a5b2522-1536-4fb7-8da6-e289d86993c3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:01.080652 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9a5b2522-1536-4fb7-8da6-e289d86993c3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:01.081331 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9a5b2522-1536-4fb7-8da6-e289d86993c3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:01.461329 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-9a5b2522-1536-4fb7-8da6-e289d86993c3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:01.471466 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-9a5b2522-1536-4fb7-8da6-e289d86993c3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.408907 Feb 03 02:58:01.473471 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 154/313] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:01 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:01.489408 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-e1c17dc1-5142-407e-a38a-02c706808b2c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:01.490492 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-e1c17dc1-5142-407e-a38a-02c706808b2c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 5db3a24e-6641-4f79-9d50-6b97b67ea6a9] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:01.498486 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e1c17dc1-5142-407e-a38a-02c706808b2c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:01.499766 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e1c17dc1-5142-407e-a38a-02c706808b2c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:01.504222 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e1c17dc1-5142-407e-a38a-02c706808b2c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:01.504804 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e1c17dc1-5142-407e-a38a-02c706808b2c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:01.522718 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-5f94c215-fbf1-499f-bede-1a2c9570d565 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:01.530316 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-5f94c215-fbf1-499f-bede-1a2c9570d565 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92" status: 200 len: 1313 microversion: 2.1 time: 0.495803 Feb 03 02:58:01.530910 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 160/314] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:01 2022] GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92 => generated 1313 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:01.945783 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-e1c17dc1-5142-407e-a38a-02c706808b2c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:01.959786 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-e1c17dc1-5142-407e-a38a-02c706808b2c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9" status: 200 len: 1317 microversion: 2.1 time: 0.484900 Feb 03 02:58:01.964125 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 155/315] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:01 2022] GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9 => generated 1317 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:02.193941 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-743cf8c4-959e-4682-899d-52cfd9a72e3d req-83faf2ea-5ff8-408b-8bd3-b6d998866194 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5db3a24e-6641-4f79-9d50-6b97b67ea6a9", "tag": "eb42ec3a-c180-4e56-94f7-7014b20db64c"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:58:02.196668 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:58:02.196668 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 02:58:02.215767 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-743cf8c4-959e-4682-899d-52cfd9a72e3d req-83faf2ea-5ff8-408b-8bd3-b6d998866194 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:02.218007 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-743cf8c4-959e-4682-899d-52cfd9a72e3d req-83faf2ea-5ff8-408b-8bd3-b6d998866194 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:02.244035 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-743cf8c4-959e-4682-899d-52cfd9a72e3d req-83faf2ea-5ff8-408b-8bd3-b6d998866194 service nova] Creating event network-changed:eb42ec3a-c180-4e56-94f7-7014b20db64c for instance 5db3a24e-6641-4f79-9d50-6b97b67ea6a9 on hv-cinder-82758 Feb 03 02:58:02.251698 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-743cf8c4-959e-4682-899d-52cfd9a72e3d req-83faf2ea-5ff8-408b-8bd3-b6d998866194 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061488 Feb 03 02:58:02.252691 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 161/316] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:58:02.498029 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-cf70477e-1f37-4592-bc5b-0ea13e8a8f83 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:02.499417 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-cf70477e-1f37-4592-bc5b-0ea13e8a8f83 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:02.508468 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-cf70477e-1f37-4592-bc5b-0ea13e8a8f83 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:02.509293 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-cf70477e-1f37-4592-bc5b-0ea13e8a8f83 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:02.510331 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-cf70477e-1f37-4592-bc5b-0ea13e8a8f83 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:02.510920 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-cf70477e-1f37-4592-bc5b-0ea13e8a8f83 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:02.557706 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-26c65077-10f1-45cb-b9b7-a70c9af32bb9 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:02.563809 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-26c65077-10f1-45cb-b9b7-a70c9af32bb9 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: 04dd696f-26bd-4f5f-957d-797a7c6aab92] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:02.586021 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-26c65077-10f1-45cb-b9b7-a70c9af32bb9 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:02.586530 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-26c65077-10f1-45cb-b9b7-a70c9af32bb9 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:02.589314 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-26c65077-10f1-45cb-b9b7-a70c9af32bb9 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:02.589789 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-26c65077-10f1-45cb-b9b7-a70c9af32bb9 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:02.957039 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-cf70477e-1f37-4592-bc5b-0ea13e8a8f83 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:02.967990 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-cf70477e-1f37-4592-bc5b-0ea13e8a8f83 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.478258 Feb 03 02:58:02.981300 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 156/317] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:02 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:58:02.982576 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-26c65077-10f1-45cb-b9b7-a70c9af32bb9 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:02.987831 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-dfbd244e-70ea-4e7d-9799-b353554ef612 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:02.988830 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-dfbd244e-70ea-4e7d-9799-b353554ef612 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 5db3a24e-6641-4f79-9d50-6b97b67ea6a9] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:02.995374 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-dfbd244e-70ea-4e7d-9799-b353554ef612 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:02.996109 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-26c65077-10f1-45cb-b9b7-a70c9af32bb9 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92" status: 200 len: 1313 microversion: 2.1 time: 0.450424 Feb 03 02:58:02.997626 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 162/318] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:02 2022] GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92 => generated 1313 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:03.015566 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-dfbd244e-70ea-4e7d-9799-b353554ef612 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:03.016922 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-dfbd244e-70ea-4e7d-9799-b353554ef612 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:03.017769 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-dfbd244e-70ea-4e7d-9799-b353554ef612 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:03.345388 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-dfbd244e-70ea-4e7d-9799-b353554ef612 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:03.353633 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-dfbd244e-70ea-4e7d-9799-b353554ef612 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9" status: 200 len: 1317 microversion: 2.1 time: 0.370161 Feb 03 02:58:03.354210 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 157/319] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:02 2022] GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9 => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:03.988091 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-bba405b4-9c64-418f-9d0d-093ea67586d3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:03.988822 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-bba405b4-9c64-418f-9d0d-093ea67586d3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:03.999811 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-bba405b4-9c64-418f-9d0d-093ea67586d3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:04.000594 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-bba405b4-9c64-418f-9d0d-093ea67586d3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:04.001532 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-bba405b4-9c64-418f-9d0d-093ea67586d3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:04.002023 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-bba405b4-9c64-418f-9d0d-093ea67586d3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:04.014223 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-fe013559-d76c-483f-9ae7-eda7a91ecf58 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:04.015618 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-fe013559-d76c-483f-9ae7-eda7a91ecf58 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: 04dd696f-26bd-4f5f-957d-797a7c6aab92] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:04.031371 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fe013559-d76c-483f-9ae7-eda7a91ecf58 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:04.032167 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fe013559-d76c-483f-9ae7-eda7a91ecf58 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:04.034185 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fe013559-d76c-483f-9ae7-eda7a91ecf58 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:04.039050 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fe013559-d76c-483f-9ae7-eda7a91ecf58 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:05.048096 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-bba405b4-9c64-418f-9d0d-093ea67586d3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:05.055741 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-bba405b4-9c64-418f-9d0d-093ea67586d3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 1.072164 Feb 03 02:58:05.065105 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-fe013559-d76c-483f-9ae7-eda7a91ecf58 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:05.075482 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-fe013559-d76c-483f-9ae7-eda7a91ecf58 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92" status: 200 len: 1313 microversion: 2.1 time: 1.064996 Feb 03 02:58:05.084981 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 163/320] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:03 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:05.085278 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 158/321] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:04 2022] GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92 => generated 1313 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:58:05.085561 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-6b1823aa-cf26-498b-af25-822c7d6f71f9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:05.085561 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-6b1823aa-cf26-498b-af25-822c7d6f71f9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 5db3a24e-6641-4f79-9d50-6b97b67ea6a9] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:05.094892 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6b1823aa-cf26-498b-af25-822c7d6f71f9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:05.095340 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6b1823aa-cf26-498b-af25-822c7d6f71f9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:05.096258 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6b1823aa-cf26-498b-af25-822c7d6f71f9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:05.106055 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6b1823aa-cf26-498b-af25-822c7d6f71f9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:05.350511 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-6b1823aa-cf26-498b-af25-822c7d6f71f9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:05.370109 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-6b1823aa-cf26-498b-af25-822c7d6f71f9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9" status: 200 len: 1317 microversion: 2.1 time: 0.292206 Feb 03 02:58:05.370691 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 164/322] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:05 2022] GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9 => generated 1317 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:06.094021 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-6ba6db6b-b2be-45dd-9a39-71070906eb55 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:06.094666 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-6ba6db6b-b2be-45dd-9a39-71070906eb55 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:06.101174 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-25961ec4-dd07-44a8-9019-90243cc2c98f tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:06.101978 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-25961ec4-dd07-44a8-9019-90243cc2c98f tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: 04dd696f-26bd-4f5f-957d-797a7c6aab92] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:06.119052 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6ba6db6b-b2be-45dd-9a39-71070906eb55 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:06.119052 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6ba6db6b-b2be-45dd-9a39-71070906eb55 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:06.119052 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6ba6db6b-b2be-45dd-9a39-71070906eb55 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:06.119052 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6ba6db6b-b2be-45dd-9a39-71070906eb55 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:06.124822 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-25961ec4-dd07-44a8-9019-90243cc2c98f tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:06.125237 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-25961ec4-dd07-44a8-9019-90243cc2c98f tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:06.126089 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-25961ec4-dd07-44a8-9019-90243cc2c98f tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:06.130569 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-25961ec4-dd07-44a8-9019-90243cc2c98f tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:06.413880 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-25961ec4-dd07-44a8-9019-90243cc2c98f tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:06.427504 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-25961ec4-dd07-44a8-9019-90243cc2c98f tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92" status: 200 len: 1313 microversion: 2.1 time: 0.336910 Feb 03 02:58:06.428110 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 159/323] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:06 2022] GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92 => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:06.445147 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-7eedbb2d-9ed6-476e-b41e-7485864a017b tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:06.445873 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-7eedbb2d-9ed6-476e-b41e-7485864a017b tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 5db3a24e-6641-4f79-9d50-6b97b67ea6a9] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:06.457097 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7eedbb2d-9ed6-476e-b41e-7485864a017b tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:06.457097 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7eedbb2d-9ed6-476e-b41e-7485864a017b tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:06.457919 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7eedbb2d-9ed6-476e-b41e-7485864a017b tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:06.458360 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7eedbb2d-9ed6-476e-b41e-7485864a017b tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:06.552125 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-6ba6db6b-b2be-45dd-9a39-71070906eb55 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:06.566355 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-6ba6db6b-b2be-45dd-9a39-71070906eb55 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.476223 Feb 03 02:58:06.566898 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 165/324] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:06 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:06.823954 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-7eedbb2d-9ed6-476e-b41e-7485864a017b tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:06.836267 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-7eedbb2d-9ed6-476e-b41e-7485864a017b tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9" status: 200 len: 1317 microversion: 2.1 time: 0.402884 Feb 03 02:58:06.838198 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 160/325] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:06 2022] GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9 => generated 1317 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:07.400440 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-66f77fd6-c677-4b66-a5e2-e4b9bf1f9259 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Action: 'create', calling method: .version_select at 0x7ff99d8e8940>, body: {"keypair": {"name": "tempest-keypair-510769156"}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:58:07.419573 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.quota [None req-66f77fd6-c677-4b66-a5e2-e4b9bf1f9259 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Getting quotas for project e8467ff017574f36b1c31db5579a56ce. Resources: {'key_pairs'} {{(pid=116386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 02:58:07.423542 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.quota [None req-66f77fd6-c677-4b66-a5e2-e4b9bf1f9259 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Getting quotas for user aa4fbbf421f34df6b34b27f3ee5247b1 and project e8467ff017574f36b1c31db5579a56ce. Resources: {'key_pairs'} {{(pid=116386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 02:58:07.450328 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-9a872846-ed36-4311-975e-3a2625da70fe tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:07.451056 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-9a872846-ed36-4311-975e-3a2625da70fe tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: 04dd696f-26bd-4f5f-957d-797a7c6aab92] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:07.468806 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9a872846-ed36-4311-975e-3a2625da70fe tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:07.469447 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9a872846-ed36-4311-975e-3a2625da70fe tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:07.471843 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9a872846-ed36-4311-975e-3a2625da70fe tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:07.473312 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9a872846-ed36-4311-975e-3a2625da70fe tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:07.706562 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-9a872846-ed36-4311-975e-3a2625da70fe tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:07.717054 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-9a872846-ed36-4311-975e-3a2625da70fe tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92" status: 200 len: 1313 microversion: 2.1 time: 0.277105 Feb 03 02:58:07.718061 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 161/326] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:07 2022] GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92 => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:07.724119 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-8c3b4869-629f-459b-b3b2-ac35027717b1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:07.726003 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-8c3b4869-629f-459b-b3b2-ac35027717b1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:07.738571 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8c3b4869-629f-459b-b3b2-ac35027717b1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:07.739043 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8c3b4869-629f-459b-b3b2-ac35027717b1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:07.739879 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8c3b4869-629f-459b-b3b2-ac35027717b1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:07.740425 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8c3b4869-629f-459b-b3b2-ac35027717b1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:07.904344 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-8c3b4869-629f-459b-b3b2-ac35027717b1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:07.913612 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-8c3b4869-629f-459b-b3b2-ac35027717b1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.194389 Feb 03 02:58:07.914918 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 162/327] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:07 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:07.924254 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-56e494fc-916a-4784-baf5-8469b4204de6 req-f11c144c-40b9-4776-8676-a613fb330995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04dd696f-26bd-4f5f-957d-797a7c6aab92", "name": "network-vif-plugged", "status": "completed", "tag": "0ae06c2c-985a-4e0e-bf16-df148555be51"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:58:07.926693 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:58:07.926693 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 02:58:07.950234 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-56e494fc-916a-4784-baf5-8469b4204de6 req-f11c144c-40b9-4776-8676-a613fb330995 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:07.951150 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-56e494fc-916a-4784-baf5-8469b4204de6 req-f11c144c-40b9-4776-8676-a613fb330995 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:07.967416 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-56e494fc-916a-4784-baf5-8469b4204de6 req-f11c144c-40b9-4776-8676-a613fb330995 service nova] Creating event network-vif-plugged:0ae06c2c-985a-4e0e-bf16-df148555be51 for instance 04dd696f-26bd-4f5f-957d-797a7c6aab92 on hv-cinder-82758 Feb 03 02:58:07.978716 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-56e494fc-916a-4784-baf5-8469b4204de6 req-f11c144c-40b9-4776-8676-a613fb330995 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056905 Feb 03 02:58:07.979789 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 163/328] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:58:07.987727 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-151e4a3e-b6dd-4fa4-a670-7614430d7fe9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:07.989054 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-151e4a3e-b6dd-4fa4-a670-7614430d7fe9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 5db3a24e-6641-4f79-9d50-6b97b67ea6a9] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:07.998933 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.quota [None req-66f77fd6-c677-4b66-a5e2-e4b9bf1f9259 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Getting quotas for project e8467ff017574f36b1c31db5579a56ce. Resources: {'key_pairs'} {{(pid=116386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 02:58:08.003727 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.quota [None req-66f77fd6-c677-4b66-a5e2-e4b9bf1f9259 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Getting quotas for user aa4fbbf421f34df6b34b27f3ee5247b1 and project e8467ff017574f36b1c31db5579a56ce. Resources: {'key_pairs'} {{(pid=116386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 02:58:08.015489 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-151e4a3e-b6dd-4fa4-a670-7614430d7fe9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:08.017152 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-151e4a3e-b6dd-4fa4-a670-7614430d7fe9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:08.019357 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-151e4a3e-b6dd-4fa4-a670-7614430d7fe9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:08.019564 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-66f77fd6-c677-4b66-a5e2-e4b9bf1f9259 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.738061 Feb 03 02:58:08.020881 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 166/329] 10.222.0.31 () {62 vars in 1198 bytes} [Thu Feb 3 02:58:07 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 740 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 03 02:58:08.021084 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-151e4a3e-b6dd-4fa4-a670-7614430d7fe9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:08.318572 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-151e4a3e-b6dd-4fa4-a670-7614430d7fe9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:08.327076 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-151e4a3e-b6dd-4fa4-a670-7614430d7fe9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9" status: 200 len: 1317 microversion: 2.1 time: 0.345747 Feb 03 02:58:08.329840 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 164/330] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:07 2022] GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9 => generated 1317 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:08.737664 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-51884385-ceef-4d30-88e2-9f0862622ec1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:08.738958 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-51884385-ceef-4d30-88e2-9f0862622ec1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: 04dd696f-26bd-4f5f-957d-797a7c6aab92] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:08.746945 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-51884385-ceef-4d30-88e2-9f0862622ec1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:08.747669 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-51884385-ceef-4d30-88e2-9f0862622ec1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:08.748698 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-51884385-ceef-4d30-88e2-9f0862622ec1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:08.749677 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-51884385-ceef-4d30-88e2-9f0862622ec1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:08.931362 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-3223f718-f942-4630-86bf-d9583536f677 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:08.931949 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-3223f718-f942-4630-86bf-d9583536f677 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:08.938709 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3223f718-f942-4630-86bf-d9583536f677 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:08.939252 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3223f718-f942-4630-86bf-d9583536f677 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:08.940097 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3223f718-f942-4630-86bf-d9583536f677 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:08.940598 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3223f718-f942-4630-86bf-d9583536f677 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:09.087784 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-51884385-ceef-4d30-88e2-9f0862622ec1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:09.095687 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-51884385-ceef-4d30-88e2-9f0862622ec1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92" status: 200 len: 1313 microversion: 2.1 time: 0.364341 Feb 03 02:58:09.106038 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 167/331] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:08 2022] GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92 => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:09.325962 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-3223f718-f942-4630-86bf-d9583536f677 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:09.337652 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-3223f718-f942-4630-86bf-d9583536f677 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.409997 Feb 03 02:58:09.340347 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 165/332] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:08 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:09.359406 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-42f89176-ce91-4098-89a7-cdb60e2dff85 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:09.360363 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-42f89176-ce91-4098-89a7-cdb60e2dff85 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 5db3a24e-6641-4f79-9d50-6b97b67ea6a9] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:09.368836 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-42f89176-ce91-4098-89a7-cdb60e2dff85 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:09.371226 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-42f89176-ce91-4098-89a7-cdb60e2dff85 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:09.372293 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-42f89176-ce91-4098-89a7-cdb60e2dff85 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:09.372995 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-42f89176-ce91-4098-89a7-cdb60e2dff85 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:09.683233 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-42f89176-ce91-4098-89a7-cdb60e2dff85 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:09.692069 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-42f89176-ce91-4098-89a7-cdb60e2dff85 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9" status: 200 len: 1317 microversion: 2.1 time: 0.337700 Feb 03 02:58:09.693324 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 168/333] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:09 2022] GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9 => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:10.092428 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-51b71f42-d46c-416f-843f-22104dae674e req-8d2dab72-364f-4417-a585-e1aabe738918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5db3a24e-6641-4f79-9d50-6b97b67ea6a9", "name": "network-vif-plugged", "status": "completed", "tag": "eb42ec3a-c180-4e56-94f7-7014b20db64c"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:58:10.093979 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:58:10.093979 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 02:58:10.110190 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-51b71f42-d46c-416f-843f-22104dae674e req-8d2dab72-364f-4417-a585-e1aabe738918 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:10.110778 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-51b71f42-d46c-416f-843f-22104dae674e req-8d2dab72-364f-4417-a585-e1aabe738918 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:10.114205 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-75492ae9-45ce-4471-af6c-ac2bc094c671 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:10.114826 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-75492ae9-45ce-4471-af6c-ac2bc094c671 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: 04dd696f-26bd-4f5f-957d-797a7c6aab92] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:10.126331 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-75492ae9-45ce-4471-af6c-ac2bc094c671 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:10.127247 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-51b71f42-d46c-416f-843f-22104dae674e req-8d2dab72-364f-4417-a585-e1aabe738918 service nova] Creating event network-vif-plugged:eb42ec3a-c180-4e56-94f7-7014b20db64c for instance 5db3a24e-6641-4f79-9d50-6b97b67ea6a9 on hv-cinder-82758 Feb 03 02:58:10.127490 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-75492ae9-45ce-4471-af6c-ac2bc094c671 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:10.128569 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-75492ae9-45ce-4471-af6c-ac2bc094c671 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:10.130990 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-75492ae9-45ce-4471-af6c-ac2bc094c671 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:10.133116 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-51b71f42-d46c-416f-843f-22104dae674e req-8d2dab72-364f-4417-a585-e1aabe738918 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044556 Feb 03 02:58:10.135380 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 166/334] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:58:10.261613 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-7c6ce80e-82d5-4afd-b147-5658ce20e645 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1303731009", "imageRef": "99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "17f7ee66-84e4-4ba5-b587-f73d44502290"}], "security_groups": [{"name": "tempest-securitygroup--1694074769"}], "key_name": "tempest-keypair-510769156", "user_data": "}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:58:10.372288 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-75492ae9-45ce-4471-af6c-ac2bc094c671 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:10.392614 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-75492ae9-45ce-4471-af6c-ac2bc094c671 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92" status: 200 len: 1313 microversion: 2.1 time: 0.282591 Feb 03 02:58:10.393906 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 169/335] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:10 2022] GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92 => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:58:10.397458 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.network.neutron [None req-7c6ce80e-82d5-4afd-b147-5658ce20e645 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] validate_networks() for [('17f7ee66-84e4-4ba5-b587-f73d44502290', None, None, None, None, None)] {{(pid=116385) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 03 02:58:10.409234 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-268ad484-93a6-4cdc-a866-949502112d61 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:10.409840 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-268ad484-93a6-4cdc-a866-949502112d61 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:10.416836 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-268ad484-93a6-4cdc-a866-949502112d61 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:10.417580 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-268ad484-93a6-4cdc-a866-949502112d61 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:10.418617 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-268ad484-93a6-4cdc-a866-949502112d61 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:10.419239 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-268ad484-93a6-4cdc-a866-949502112d61 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:10.996288 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-268ad484-93a6-4cdc-a866-949502112d61 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:11.004202 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-268ad484-93a6-4cdc-a866-949502112d61 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.609054 Feb 03 02:58:11.005066 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 170/336] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:10 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:11.027726 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-c38ccf2c-eebc-46ed-b05f-db5437fe4fad tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:11.028334 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-c38ccf2c-eebc-46ed-b05f-db5437fe4fad tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 5db3a24e-6641-4f79-9d50-6b97b67ea6a9] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:11.043710 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c38ccf2c-eebc-46ed-b05f-db5437fe4fad tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:11.044156 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c38ccf2c-eebc-46ed-b05f-db5437fe4fad tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:11.044977 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c38ccf2c-eebc-46ed-b05f-db5437fe4fad tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:11.045409 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c38ccf2c-eebc-46ed-b05f-db5437fe4fad tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:11.323049 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-c38ccf2c-eebc-46ed-b05f-db5437fe4fad tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:11.331674 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-c38ccf2c-eebc-46ed-b05f-db5437fe4fad tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9" status: 200 len: 1317 microversion: 2.1 time: 0.316448 Feb 03 02:58:11.334439 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 171/337] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:11 2022] GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9 => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:11.367514 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-7c6ce80e-82d5-4afd-b147-5658ce20e645 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Flavor limits 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 03 02:58:11.368072 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-7c6ce80e-82d5-4afd-b147-5658ce20e645 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Image limits 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 03 02:58:11.368391 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-7c6ce80e-82d5-4afd-b147-5658ce20e645 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Flavor pref 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 03 02:58:11.368936 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-7c6ce80e-82d5-4afd-b147-5658ce20e645 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Image pref 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 03 02:58:11.369355 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-7c6ce80e-82d5-4afd-b147-5658ce20e645 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 03 02:58:11.384058 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7c6ce80e-82d5-4afd-b147-5658ce20e645 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:11.384512 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7c6ce80e-82d5-4afd-b147-5658ce20e645 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:11.385517 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7c6ce80e-82d5-4afd-b147-5658ce20e645 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:11.385964 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7c6ce80e-82d5-4afd-b147-5658ce20e645 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:11.413824 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-d6ba8d73-3adc-4600-9aa2-d538f2a05df1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:11.414955 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-d6ba8d73-3adc-4600-9aa2-d538f2a05df1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: 04dd696f-26bd-4f5f-957d-797a7c6aab92] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:11.415376 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-7c6ce80e-82d5-4afd-b147-5658ce20e645 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Getting quotas for project e8467ff017574f36b1c31db5579a56ce. Resources: {'cores', 'ram', 'instances'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 02:58:11.420190 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-7c6ce80e-82d5-4afd-b147-5658ce20e645 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Getting quotas for user aa4fbbf421f34df6b34b27f3ee5247b1 and project e8467ff017574f36b1c31db5579a56ce. Resources: {'cores', 'ram', 'instances'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 02:58:11.427742 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d6ba8d73-3adc-4600-9aa2-d538f2a05df1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:11.428552 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d6ba8d73-3adc-4600-9aa2-d538f2a05df1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:11.429642 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d6ba8d73-3adc-4600-9aa2-d538f2a05df1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:11.430290 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d6ba8d73-3adc-4600-9aa2-d538f2a05df1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:11.442284 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-7c6ce80e-82d5-4afd-b147-5658ce20e645 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Going to run 1 instances... {{(pid=116385) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 03 02:58:11.445956 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-7c6ce80e-82d5-4afd-b147-5658ce20e645 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 03 02:58:11.557856 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-7c6ce80e-82d5-4afd-b147-5658ce20e645 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.300976 Feb 03 02:58:11.558740 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 167/338] 10.222.0.31 () {62 vars in 1187 bytes} [Thu Feb 3 02:58:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 1303 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Feb 03 02:58:11.581372 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-a77707ba-2fed-4242-a085-8b13c6e0d403 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:11.581995 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-a77707ba-2fed-4242-a085-8b13c6e0d403 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:11.732679 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-a77707ba-2fed-4242-a085-8b13c6e0d403 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:11.776482 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-a77707ba-2fed-4242-a085-8b13c6e0d403 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:11.778011 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-a77707ba-2fed-4242-a085-8b13c6e0d403 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:11.779121 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-a77707ba-2fed-4242-a085-8b13c6e0d403 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1281 microversion: 2.20 time: 0.213949 Feb 03 02:58:11.793119 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 168/339] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 02:58:11 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1281 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 03 02:58:11.951926 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-d6ba8d73-3adc-4600-9aa2-d538f2a05df1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:11.962545 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-d6ba8d73-3adc-4600-9aa2-d538f2a05df1 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92" status: 200 len: 1313 microversion: 2.1 time: 0.555406 Feb 03 02:58:11.963787 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 172/340] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:11 2022] GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92 => generated 1313 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:12.021911 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-b1d7b633-8248-4213-b726-9650eb6a9b2b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:12.022993 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-b1d7b633-8248-4213-b726-9650eb6a9b2b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:12.057137 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b1d7b633-8248-4213-b726-9650eb6a9b2b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:12.057626 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b1d7b633-8248-4213-b726-9650eb6a9b2b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:12.058466 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b1d7b633-8248-4213-b726-9650eb6a9b2b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:12.058949 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b1d7b633-8248-4213-b726-9650eb6a9b2b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:12.352466 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-c2c22245-9dcf-4c05-9e96-893aa775b10b tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:12.354607 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-c2c22245-9dcf-4c05-9e96-893aa775b10b tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 5db3a24e-6641-4f79-9d50-6b97b67ea6a9] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:12.365991 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c2c22245-9dcf-4c05-9e96-893aa775b10b tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:12.369005 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c2c22245-9dcf-4c05-9e96-893aa775b10b tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:12.370054 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c2c22245-9dcf-4c05-9e96-893aa775b10b tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:12.371433 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c2c22245-9dcf-4c05-9e96-893aa775b10b tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:12.617552 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-b1d7b633-8248-4213-b726-9650eb6a9b2b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:12.643406 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-b1d7b633-8248-4213-b726-9650eb6a9b2b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.625245 Feb 03 02:58:12.676844 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 169/341] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:12 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:12.797793 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-6fedcf03-4c84-4780-8ef5-3b0edfcfe73e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:12.798453 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-6fedcf03-4c84-4780-8ef5-3b0edfcfe73e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:12.803433 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-c2c22245-9dcf-4c05-9e96-893aa775b10b tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:12.806788 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6fedcf03-4c84-4780-8ef5-3b0edfcfe73e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:12.808977 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6fedcf03-4c84-4780-8ef5-3b0edfcfe73e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:12.811193 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6fedcf03-4c84-4780-8ef5-3b0edfcfe73e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:12.812853 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6fedcf03-4c84-4780-8ef5-3b0edfcfe73e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:12.822951 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-c2c22245-9dcf-4c05-9e96-893aa775b10b tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9" status: 200 len: 1317 microversion: 2.1 time: 0.476598 Feb 03 02:58:12.823825 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 173/342] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:12 2022] GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9 => generated 1317 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:12.892556 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-6fedcf03-4c84-4780-8ef5-3b0edfcfe73e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:12.900757 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-6fedcf03-4c84-4780-8ef5-3b0edfcfe73e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:12.902596 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-6fedcf03-4c84-4780-8ef5-3b0edfcfe73e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:12.904049 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-6fedcf03-4c84-4780-8ef5-3b0edfcfe73e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1333 microversion: 2.20 time: 0.110461 Feb 03 02:58:12.904903 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 170/343] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 02:58:12 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1333 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 03 02:58:12.984389 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-1f9a88d8-bae8-45b3-bcae-ca6e16b8f401 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:12.985717 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-1f9a88d8-bae8-45b3-bcae-ca6e16b8f401 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: 04dd696f-26bd-4f5f-957d-797a7c6aab92] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:12.998540 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1f9a88d8-bae8-45b3-bcae-ca6e16b8f401 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:13.000469 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1f9a88d8-bae8-45b3-bcae-ca6e16b8f401 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:13.001929 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1f9a88d8-bae8-45b3-bcae-ca6e16b8f401 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:13.002550 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1f9a88d8-bae8-45b3-bcae-ca6e16b8f401 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:13.296328 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-1f9a88d8-bae8-45b3-bcae-ca6e16b8f401 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:13.324679 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-1f9a88d8-bae8-45b3-bcae-ca6e16b8f401 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92" status: 200 len: 1497 microversion: 2.1 time: 0.347825 Feb 03 02:58:13.341072 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 174/344] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:12 2022] GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92 => generated 1497 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:13.663450 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-c9f3ec7f-9fec-4180-999d-4e2b523c2687 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:13.664055 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-c9f3ec7f-9fec-4180-999d-4e2b523c2687 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:13.684652 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c9f3ec7f-9fec-4180-999d-4e2b523c2687 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:13.684900 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c9f3ec7f-9fec-4180-999d-4e2b523c2687 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:13.685717 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c9f3ec7f-9fec-4180-999d-4e2b523c2687 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:13.686145 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c9f3ec7f-9fec-4180-999d-4e2b523c2687 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:13.840507 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-a1918661-6f4b-4e8c-8c28-30bdb57ec3fe tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:13.841328 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-a1918661-6f4b-4e8c-8c28-30bdb57ec3fe tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 5db3a24e-6641-4f79-9d50-6b97b67ea6a9] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:13.859623 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a1918661-6f4b-4e8c-8c28-30bdb57ec3fe tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:13.860291 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a1918661-6f4b-4e8c-8c28-30bdb57ec3fe tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:13.861911 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a1918661-6f4b-4e8c-8c28-30bdb57ec3fe tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:13.865432 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a1918661-6f4b-4e8c-8c28-30bdb57ec3fe tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:14.347603 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-c9f3ec7f-9fec-4180-999d-4e2b523c2687 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:14.356543 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-c9f3ec7f-9fec-4180-999d-4e2b523c2687 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.698145 Feb 03 02:58:14.357218 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 171/345] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:13 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:58:14.364232 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-f4676d59-ea79-4544-930a-829b1fc1a72b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:14.364938 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-f4676d59-ea79-4544-930a-829b1fc1a72b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:14.372298 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f4676d59-ea79-4544-930a-829b1fc1a72b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:14.372760 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f4676d59-ea79-4544-930a-829b1fc1a72b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:14.373601 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f4676d59-ea79-4544-930a-829b1fc1a72b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:14.374038 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f4676d59-ea79-4544-930a-829b1fc1a72b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:14.480956 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-f4676d59-ea79-4544-930a-829b1fc1a72b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:14.489308 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-f4676d59-ea79-4544-930a-829b1fc1a72b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:14.490766 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-f4676d59-ea79-4544-930a-829b1fc1a72b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:14.491869 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-f4676d59-ea79-4544-930a-829b1fc1a72b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1339 microversion: 2.20 time: 0.133588 Feb 03 02:58:14.492427 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 172/346] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 02:58:14 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1339 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 02:58:14.498213 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-a1918661-6f4b-4e8c-8c28-30bdb57ec3fe tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:14.509172 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-39b2c957-1201-48f9-91d7-dcf47e2747b7 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:14.509487 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-a1918661-6f4b-4e8c-8c28-30bdb57ec3fe tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9" status: 200 len: 1507 microversion: 2.1 time: 0.669258 Feb 03 02:58:14.510371 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 175/347] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:13 2022] GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9 => generated 1507 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:58:14.511016 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-39b2c957-1201-48f9-91d7-dcf47e2747b7 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: 04dd696f-26bd-4f5f-957d-797a7c6aab92] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:14.526661 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-39b2c957-1201-48f9-91d7-dcf47e2747b7 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:14.527133 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-39b2c957-1201-48f9-91d7-dcf47e2747b7 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:14.527980 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-39b2c957-1201-48f9-91d7-dcf47e2747b7 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:14.528444 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-39b2c957-1201-48f9-91d7-dcf47e2747b7 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:14.571797 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-39b2c957-1201-48f9-91d7-dcf47e2747b7 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: 04dd696f-26bd-4f5f-957d-797a7c6aab92] Going to try to terminate instance {{(pid=116385) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 03 02:58:14.697706 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-39b2c957-1201-48f9-91d7-dcf47e2747b7 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "DELETE /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92" status: 204 len: 0 microversion: 2.1 time: 0.203713 Feb 03 02:58:14.701044 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 173/348] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Feb 3 02:58:14 2022] DELETE /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 03 02:58:14.710866 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-3848503b-4a51-41c4-8290-3440e7cee885 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:14.711732 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-3848503b-4a51-41c4-8290-3440e7cee885 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: 04dd696f-26bd-4f5f-957d-797a7c6aab92] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:14.718232 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3848503b-4a51-41c4-8290-3440e7cee885 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:14.718981 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3848503b-4a51-41c4-8290-3440e7cee885 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:14.719836 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3848503b-4a51-41c4-8290-3440e7cee885 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:14.720244 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3848503b-4a51-41c4-8290-3440e7cee885 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:15.292379 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-3848503b-4a51-41c4-8290-3440e7cee885 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:15.310478 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-3848503b-4a51-41c4-8290-3440e7cee885 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92" status: 200 len: 1503 microversion: 2.1 time: 0.597627 Feb 03 02:58:15.322346 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 176/349] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:14 2022] GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92 => generated 1503 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:15.375289 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-43f99f30-b4b6-4d1c-8f05-95178d7a43fa tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:15.376047 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-43f99f30-b4b6-4d1c-8f05-95178d7a43fa tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:15.383602 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-43f99f30-b4b6-4d1c-8f05-95178d7a43fa tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:15.384356 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-43f99f30-b4b6-4d1c-8f05-95178d7a43fa tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:15.385202 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-43f99f30-b4b6-4d1c-8f05-95178d7a43fa tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:15.385626 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-43f99f30-b4b6-4d1c-8f05-95178d7a43fa tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:15.510101 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-a4e4afec-1c7f-414c-b0d7-a23909c676af tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:15.510903 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-a4e4afec-1c7f-414c-b0d7-a23909c676af tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:15.524657 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a4e4afec-1c7f-414c-b0d7-a23909c676af tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:15.528135 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a4e4afec-1c7f-414c-b0d7-a23909c676af tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:15.529164 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a4e4afec-1c7f-414c-b0d7-a23909c676af tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:15.529618 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a4e4afec-1c7f-414c-b0d7-a23909c676af tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:16.008040 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-43f99f30-b4b6-4d1c-8f05-95178d7a43fa tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:16.017428 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-43f99f30-b4b6-4d1c-8f05-95178d7a43fa tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1519 microversion: 2.1 time: 0.647192 Feb 03 02:58:16.019179 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 174/350] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:15 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1519 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:16.025107 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-8dbab732-ae88-4796-9375-ac918da19de9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14bfac71-0fb8-4333-87c3-fa7751c982ea"}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:58:16.026516 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-8dbab732-ae88-4796-9375-ac918da19de9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 5db3a24e-6641-4f79-9d50-6b97b67ea6a9] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:16.034088 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8dbab732-ae88-4796-9375-ac918da19de9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:16.034866 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8dbab732-ae88-4796-9375-ac918da19de9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:16.035883 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8dbab732-ae88-4796-9375-ac918da19de9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:16.036645 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8dbab732-ae88-4796-9375-ac918da19de9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:16.149861 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-a4e4afec-1c7f-414c-b0d7-a23909c676af tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:16.176508 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-a4e4afec-1c7f-414c-b0d7-a23909c676af tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:16.180620 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-a4e4afec-1c7f-414c-b0d7-a23909c676af tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:16.182011 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-a4e4afec-1c7f-414c-b0d7-a23909c676af tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1407 microversion: 2.20 time: 0.675750 Feb 03 02:58:16.182740 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 177/351] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 02:58:15 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1407 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 03 02:58:16.328272 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-4b546825-9fda-4369-9604-321b8ce709c3 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:16.328908 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-4b546825-9fda-4369-9604-321b8ce709c3 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: 04dd696f-26bd-4f5f-957d-797a7c6aab92] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:16.336259 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4b546825-9fda-4369-9604-321b8ce709c3 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:16.337252 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4b546825-9fda-4369-9604-321b8ce709c3 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:16.339190 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4b546825-9fda-4369-9604-321b8ce709c3 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:16.341721 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4b546825-9fda-4369-9604-321b8ce709c3 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:16.355837 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-8dbab732-ae88-4796-9375-ac918da19de9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "POST /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332348 Feb 03 02:58:16.356586 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 175/352] 10.222.0.31 () {60 vars in 1322 bytes} [Thu Feb 3 02:58:16 2022] POST /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:58:16.673747 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-4b546825-9fda-4369-9604-321b8ce709c3 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:16.694177 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-4b546825-9fda-4369-9604-321b8ce709c3 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92" status: 200 len: 1503 microversion: 2.1 time: 0.370165 Feb 03 02:58:16.695178 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 178/353] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:16 2022] GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92 => generated 1503 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:58:16.995520 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-8bd3607f-196a-4f5d-861e-8e462c9ae063 req-8337f74d-2b2a-4d8c-bd0d-aa6e85948778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0708ed4-206d-484e-a2b4-dfb7733d415b", "tag": "27c8015c-4643-475a-85ae-a540d30129eb"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:58:16.997645 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:58:16.997645 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 02:58:17.030643 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-8bd3607f-196a-4f5d-861e-8e462c9ae063 req-8337f74d-2b2a-4d8c-bd0d-aa6e85948778 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:17.031212 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-8bd3607f-196a-4f5d-861e-8e462c9ae063 req-8337f74d-2b2a-4d8c-bd0d-aa6e85948778 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:17.035030 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-fd046779-9da9-457e-a299-f66e2e00ebe3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:17.035691 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-fd046779-9da9-457e-a299-f66e2e00ebe3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:17.055829 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fd046779-9da9-457e-a299-f66e2e00ebe3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:17.056284 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fd046779-9da9-457e-a299-f66e2e00ebe3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:17.057145 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fd046779-9da9-457e-a299-f66e2e00ebe3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:17.057587 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fd046779-9da9-457e-a299-f66e2e00ebe3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:17.058484 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-8bd3607f-196a-4f5d-861e-8e462c9ae063 req-8337f74d-2b2a-4d8c-bd0d-aa6e85948778 service nova] Creating event network-changed:27c8015c-4643-475a-85ae-a540d30129eb for instance e0708ed4-206d-484e-a2b4-dfb7733d415b on hv-cinder-82758 Feb 03 02:58:17.069455 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-8bd3607f-196a-4f5d-861e-8e462c9ae063 req-8337f74d-2b2a-4d8c-bd0d-aa6e85948778 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083720 Feb 03 02:58:17.075285 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 176/354] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:58:17.202466 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-2ace3147-3fd3-4272-97db-999a51c953f8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:17.203532 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-2ace3147-3fd3-4272-97db-999a51c953f8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:17.217351 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2ace3147-3fd3-4272-97db-999a51c953f8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:17.219235 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2ace3147-3fd3-4272-97db-999a51c953f8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:17.220297 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2ace3147-3fd3-4272-97db-999a51c953f8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:17.221896 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2ace3147-3fd3-4272-97db-999a51c953f8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:17.502618 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-fd046779-9da9-457e-a299-f66e2e00ebe3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:17.511210 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-fd046779-9da9-457e-a299-f66e2e00ebe3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1499 microversion: 2.1 time: 0.479970 Feb 03 02:58:17.511786 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 179/355] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:17 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1499 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:17.535981 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-1a283c78-1f0a-43ce-ab27-ee5fd2204217 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:17.536799 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-1a283c78-1f0a-43ce-ab27-ee5fd2204217 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:17.546401 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1a283c78-1f0a-43ce-ab27-ee5fd2204217 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:17.547351 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1a283c78-1f0a-43ce-ab27-ee5fd2204217 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:17.548360 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1a283c78-1f0a-43ce-ab27-ee5fd2204217 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:17.549171 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1a283c78-1f0a-43ce-ab27-ee5fd2204217 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:17.772823 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-2ace3147-3fd3-4272-97db-999a51c953f8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:17.782509 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-2ace3147-3fd3-4272-97db-999a51c953f8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:17.784708 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-2ace3147-3fd3-4272-97db-999a51c953f8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:17.786103 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-2ace3147-3fd3-4272-97db-999a51c953f8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1407 microversion: 2.20 time: 0.589723 Feb 03 02:58:17.797401 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 177/356] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 02:58:17 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1407 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 02:58:17.802829 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-04539ed9-f4c2-4094-8486-bbd0c01ad9af tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:17.803754 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-04539ed9-f4c2-4094-8486-bbd0c01ad9af tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: 04dd696f-26bd-4f5f-957d-797a7c6aab92] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:17.810328 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-04539ed9-f4c2-4094-8486-bbd0c01ad9af tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:17.811199 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-04539ed9-f4c2-4094-8486-bbd0c01ad9af tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:17.812041 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-04539ed9-f4c2-4094-8486-bbd0c01ad9af tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:17.812696 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-04539ed9-f4c2-4094-8486-bbd0c01ad9af tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:17.962071 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-04539ed9-f4c2-4094-8486-bbd0c01ad9af tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3754bf46af13470faf170277d5086e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c4256dc55e466d95808fa66f72c37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:17.981657 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-04539ed9-f4c2-4094-8486-bbd0c01ad9af tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92" status: 200 len: 1298 microversion: 2.1 time: 0.182162 Feb 03 02:58:17.983790 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 178/357] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:17 2022] GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92 => generated 1298 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:17.994800 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-f621a66c-898c-4465-9615-614359f8f45d req-5b22bfd6-9987-4fe7-95a5-a1cb52eff60d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04dd696f-26bd-4f5f-957d-797a7c6aab92", "name": "network-vif-deleted", "tag": "0ae06c2c-985a-4e0e-bf16-df148555be51"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:58:17.997656 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:58:17.997656 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 02:58:18.009198 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-f621a66c-898c-4465-9615-614359f8f45d req-5b22bfd6-9987-4fe7-95a5-a1cb52eff60d service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:18.011394 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-f621a66c-898c-4465-9615-614359f8f45d req-5b22bfd6-9987-4fe7-95a5-a1cb52eff60d service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:18.030205 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-f621a66c-898c-4465-9615-614359f8f45d req-5b22bfd6-9987-4fe7-95a5-a1cb52eff60d service nova] Creating event network-vif-deleted:0ae06c2c-985a-4e0e-bf16-df148555be51 for instance 04dd696f-26bd-4f5f-957d-797a7c6aab92 on hv-cinder-82758 Feb 03 02:58:18.037228 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-f621a66c-898c-4465-9615-614359f8f45d req-5b22bfd6-9987-4fe7-95a5-a1cb52eff60d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051620 Feb 03 02:58:18.045771 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 179/358] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:58:18.157140 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-1a283c78-1f0a-43ce-ab27-ee5fd2204217 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:18.167705 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-1a283c78-1f0a-43ce-ab27-ee5fd2204217 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1513 microversion: 2.1 time: 0.643512 Feb 03 02:58:18.168961 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 180/359] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:17 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1513 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:18.805613 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-567a0b84-3bc1-4f9a-85a4-8ae8aafa2c5d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:18.806529 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-567a0b84-3bc1-4f9a-85a4-8ae8aafa2c5d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:18.815651 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-567a0b84-3bc1-4f9a-85a4-8ae8aafa2c5d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:18.816631 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-567a0b84-3bc1-4f9a-85a4-8ae8aafa2c5d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:18.818260 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-567a0b84-3bc1-4f9a-85a4-8ae8aafa2c5d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:18.819057 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-567a0b84-3bc1-4f9a-85a4-8ae8aafa2c5d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:19.000321 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-247044de-f6ee-40c1-8dce-19f0b3358c68 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:19.001914 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-247044de-f6ee-40c1-8dce-19f0b3358c68 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] [instance: 04dd696f-26bd-4f5f-957d-797a7c6aab92] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:19.011140 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-247044de-f6ee-40c1-8dce-19f0b3358c68 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:19.011882 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-247044de-f6ee-40c1-8dce-19f0b3358c68 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:19.013166 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-247044de-f6ee-40c1-8dce-19f0b3358c68 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:19.013796 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-247044de-f6ee-40c1-8dce-19f0b3358c68 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:19.051840 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.wsgi [None req-247044de-f6ee-40c1-8dce-19f0b3358c68 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] HTTP exception thrown: Instance 04dd696f-26bd-4f5f-957d-797a7c6aab92 could not be found. Feb 03 02:58:19.052570 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-247044de-f6ee-40c1-8dce-19f0b3358c68 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] Returning 404 to user: Instance 04dd696f-26bd-4f5f-957d-797a7c6aab92 could not be found. {{(pid=116386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 02:58:19.053292 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-247044de-f6ee-40c1-8dce-19f0b3358c68 tempest-VolumesActionsTest-347322714 tempest-VolumesActionsTest-347322714-project] 10.222.0.31 "GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92" status: 404 len: 111 microversion: 2.1 time: 0.058523 Feb 03 02:58:19.054126 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 181/360] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:18 2022] GET /compute/v2.1/servers/04dd696f-26bd-4f5f-957d-797a7c6aab92 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 02:58:19.090821 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-567a0b84-3bc1-4f9a-85a4-8ae8aafa2c5d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:19.100001 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-567a0b84-3bc1-4f9a-85a4-8ae8aafa2c5d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:19.104506 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-567a0b84-3bc1-4f9a-85a4-8ae8aafa2c5d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:19.110167 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-567a0b84-3bc1-4f9a-85a4-8ae8aafa2c5d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1407 microversion: 2.20 time: 0.310302 Feb 03 02:58:19.113081 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 180/361] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 02:58:18 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1407 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 02:58:19.878665 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-0b57026a-7e86-431f-b373-51022ffabe8c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:58:19.880125 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-0b57026a-7e86-431f-b373-51022ffabe8c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:19.886534 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0b57026a-7e86-431f-b373-51022ffabe8c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:19.887195 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0b57026a-7e86-431f-b373-51022ffabe8c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:19.888155 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0b57026a-7e86-431f-b373-51022ffabe8c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:19.888787 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0b57026a-7e86-431f-b373-51022ffabe8c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:19.945883 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.objects.instance [None req-0b57026a-7e86-431f-b373-51022ffabe8c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lazy-loading 'flavor' on Instance uuid 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e {{(pid=116386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 03 02:58:20.121847 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-0b57026a-7e86-431f-b373-51022ffabe8c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "POST /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e/action" status: 200 len: 32 microversion: 2.1 time: 0.246627 Feb 03 02:58:20.125166 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 182/362] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Feb 3 02:58:19 2022] POST /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e/action => generated 32 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 03 02:58:20.135960 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-cf89d943-5cf4-4269-b934-4d6cfd883129 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:20.136582 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-cf89d943-5cf4-4269-b934-4d6cfd883129 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:20.151863 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-cf89d943-5cf4-4269-b934-4d6cfd883129 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:20.152313 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-cf89d943-5cf4-4269-b934-4d6cfd883129 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:20.162018 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-cf89d943-5cf4-4269-b934-4d6cfd883129 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:20.162473 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-cf89d943-5cf4-4269-b934-4d6cfd883129 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:20.165798 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-d51d575e-a7ea-481c-b37f-00b5282d8d94 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:20.166501 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-d51d575e-a7ea-481c-b37f-00b5282d8d94 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:20.181274 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d51d575e-a7ea-481c-b37f-00b5282d8d94 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:20.190331 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d51d575e-a7ea-481c-b37f-00b5282d8d94 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:20.191409 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d51d575e-a7ea-481c-b37f-00b5282d8d94 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:20.197353 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d51d575e-a7ea-481c-b37f-00b5282d8d94 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:20.923724 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-cf89d943-5cf4-4269-b934-4d6cfd883129 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:20.931866 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-cf89d943-5cf4-4269-b934-4d6cfd883129 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1519 microversion: 2.1 time: 0.801693 Feb 03 02:58:20.932779 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 181/363] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:20 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1519 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:20.937838 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-d51d575e-a7ea-481c-b37f-00b5282d8d94 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:20.946369 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-d51d575e-a7ea-481c-b37f-00b5282d8d94 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:20.948176 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-d51d575e-a7ea-481c-b37f-00b5282d8d94 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:20.949448 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-d51d575e-a7ea-481c-b37f-00b5282d8d94 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1407 microversion: 2.20 time: 0.804632 Feb 03 02:58:20.950077 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 183/364] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 02:58:20 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1407 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 02:58:21.949097 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-ef68429a-471f-4ee5-b013-7f8074a27d21 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:21.950356 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-ef68429a-471f-4ee5-b013-7f8074a27d21 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:21.959453 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ef68429a-471f-4ee5-b013-7f8074a27d21 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:21.959899 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ef68429a-471f-4ee5-b013-7f8074a27d21 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:21.960704 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ef68429a-471f-4ee5-b013-7f8074a27d21 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:21.961130 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ef68429a-471f-4ee5-b013-7f8074a27d21 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:21.971276 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-17d26dcc-7b1d-442f-a97e-142f454a036a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:21.971869 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-17d26dcc-7b1d-442f-a97e-142f454a036a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:21.981639 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-17d26dcc-7b1d-442f-a97e-142f454a036a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:21.982079 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-17d26dcc-7b1d-442f-a97e-142f454a036a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:21.982874 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-17d26dcc-7b1d-442f-a97e-142f454a036a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:21.983305 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-17d26dcc-7b1d-442f-a97e-142f454a036a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:22.450138 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-17d26dcc-7b1d-442f-a97e-142f454a036a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:22.464391 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-ef68429a-471f-4ee5-b013-7f8074a27d21 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:22.469363 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-17d26dcc-7b1d-442f-a97e-142f454a036a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:22.471339 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-17d26dcc-7b1d-442f-a97e-142f454a036a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:22.472791 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-ef68429a-471f-4ee5-b013-7f8074a27d21 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1519 microversion: 2.1 time: 0.527313 Feb 03 02:58:22.477124 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 182/365] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:21 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1519 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:22.486599 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-17d26dcc-7b1d-442f-a97e-142f454a036a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1407 microversion: 2.20 time: 0.506088 Feb 03 02:58:22.496877 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 184/366] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 02:58:21 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1407 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 03 02:58:23.490362 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-a51e6b32-bbdb-42b3-894d-0a84a9eacbab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:23.491658 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-a51e6b32-bbdb-42b3-894d-0a84a9eacbab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:23.505077 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-8de2488c-26ca-4a96-96f9-4cf05fb24280 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:23.510379 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-8de2488c-26ca-4a96-96f9-4cf05fb24280 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:23.521000 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8de2488c-26ca-4a96-96f9-4cf05fb24280 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:23.521513 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8de2488c-26ca-4a96-96f9-4cf05fb24280 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:23.522416 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8de2488c-26ca-4a96-96f9-4cf05fb24280 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:23.523069 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8de2488c-26ca-4a96-96f9-4cf05fb24280 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:23.531101 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a51e6b32-bbdb-42b3-894d-0a84a9eacbab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:23.532032 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a51e6b32-bbdb-42b3-894d-0a84a9eacbab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:23.534472 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a51e6b32-bbdb-42b3-894d-0a84a9eacbab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:23.537570 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a51e6b32-bbdb-42b3-894d-0a84a9eacbab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:23.964929 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-8de2488c-26ca-4a96-96f9-4cf05fb24280 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:23.978649 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-8de2488c-26ca-4a96-96f9-4cf05fb24280 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:23.980213 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-8de2488c-26ca-4a96-96f9-4cf05fb24280 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:23.985947 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-8de2488c-26ca-4a96-96f9-4cf05fb24280 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1407 microversion: 2.20 time: 0.484802 Feb 03 02:58:23.986535 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 185/367] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 02:58:23 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1407 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 03 02:58:24.109345 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-a51e6b32-bbdb-42b3-894d-0a84a9eacbab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:24.120487 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-a51e6b32-bbdb-42b3-894d-0a84a9eacbab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1519 microversion: 2.1 time: 0.633021 Feb 03 02:58:24.122464 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 183/368] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:23 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1519 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:24.325273 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-3c509ae8-862f-4590-9210-7e00136ddc0f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Action: 'create', calling method: .version_select at 0x7ff99db0a280>, body: {"keypair": {"name": "tempest-TestShelveInstance-2139397802"}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:58:24.340232 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.quota [None req-3c509ae8-862f-4590-9210-7e00136ddc0f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Getting quotas for project 4cde077871f94db3a608b5b79c01883e. Resources: {'key_pairs'} {{(pid=116386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 02:58:24.344088 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.quota [None req-3c509ae8-862f-4590-9210-7e00136ddc0f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Getting quotas for user 2eb1f6ef4005482f8dba7efb00068639 and project 4cde077871f94db3a608b5b79c01883e. Resources: {'key_pairs'} {{(pid=116386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 02:58:24.829411 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.quota [None req-3c509ae8-862f-4590-9210-7e00136ddc0f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Getting quotas for project 4cde077871f94db3a608b5b79c01883e. Resources: {'key_pairs'} {{(pid=116386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 02:58:24.834502 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.quota [None req-3c509ae8-862f-4590-9210-7e00136ddc0f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Getting quotas for user 2eb1f6ef4005482f8dba7efb00068639 and project 4cde077871f94db3a608b5b79c01883e. Resources: {'key_pairs'} {{(pid=116386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 02:58:24.849689 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-3c509ae8-862f-4590-9210-7e00136ddc0f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.861813 Feb 03 02:58:24.850177 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 186/369] 10.222.0.31 () {60 vars in 1157 bytes} [Thu Feb 3 02:58:23 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:25.009733 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-4e81e850-6020-4e51-971e-bd07b8f8c5b1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:25.010344 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-4e81e850-6020-4e51-971e-bd07b8f8c5b1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:25.019403 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4e81e850-6020-4e51-971e-bd07b8f8c5b1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:25.019853 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4e81e850-6020-4e51-971e-bd07b8f8c5b1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:25.020636 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4e81e850-6020-4e51-971e-bd07b8f8c5b1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:25.021100 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4e81e850-6020-4e51-971e-bd07b8f8c5b1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:25.141097 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-93221150-340f-4d45-8081-06348fb3497c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:25.141861 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-93221150-340f-4d45-8081-06348fb3497c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:25.164419 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-93221150-340f-4d45-8081-06348fb3497c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:25.164419 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-93221150-340f-4d45-8081-06348fb3497c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:25.169323 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-93221150-340f-4d45-8081-06348fb3497c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:25.170220 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-93221150-340f-4d45-8081-06348fb3497c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:25.321714 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-4e81e850-6020-4e51-971e-bd07b8f8c5b1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:25.335592 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-4e81e850-6020-4e51-971e-bd07b8f8c5b1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:25.337485 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-4e81e850-6020-4e51-971e-bd07b8f8c5b1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:25.344340 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-4e81e850-6020-4e51-971e-bd07b8f8c5b1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1407 microversion: 2.20 time: 0.344601 Feb 03 02:58:25.345876 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 184/370] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 02:58:24 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1407 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 02:58:25.369569 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-4f7a0135-7f36-4f84-8c60-c6a51dc0c00c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14bfac71-0fb8-4333-87c3-fa7751c982ea"}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:58:25.373437 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-4f7a0135-7f36-4f84-8c60-c6a51dc0c00c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 5db3a24e-6641-4f79-9d50-6b97b67ea6a9] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:25.383462 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4f7a0135-7f36-4f84-8c60-c6a51dc0c00c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:25.384185 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4f7a0135-7f36-4f84-8c60-c6a51dc0c00c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:25.385344 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4f7a0135-7f36-4f84-8c60-c6a51dc0c00c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:25.386027 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4f7a0135-7f36-4f84-8c60-c6a51dc0c00c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:25.477091 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-93221150-340f-4d45-8081-06348fb3497c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:25.487865 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-93221150-340f-4d45-8081-06348fb3497c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1519 microversion: 2.1 time: 0.351212 Feb 03 02:58:25.489613 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 187/371] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:25 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1519 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:25.574752 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.wsgi [None req-4f7a0135-7f36-4f84-8c60-c6a51dc0c00c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] HTTP exception thrown: Invalid volume: volume 14bfac71-0fb8-4333-87c3-fa7751c982ea is already attached to instances: 5db3a24e-6641-4f79-9d50-6b97b67ea6a9 Feb 03 02:58:25.580520 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-4f7a0135-7f36-4f84-8c60-c6a51dc0c00c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Returning 400 to user: Invalid volume: volume 14bfac71-0fb8-4333-87c3-fa7751c982ea is already attached to instances: 5db3a24e-6641-4f79-9d50-6b97b67ea6a9 {{(pid=116385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 02:58:25.581868 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-4f7a0135-7f36-4f84-8c60-c6a51dc0c00c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "POST /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.215782 Feb 03 02:58:25.586171 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 185/372] 10.222.0.31 () {60 vars in 1322 bytes} [Thu Feb 3 02:58:25 2022] POST /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9/os-volume_attachments => generated 174 bytes in 221 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 03 02:58:25.725803 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-b3822668-d8c1-4b16-a8f6-9f4a39538e97 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:25.726347 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-b3822668-d8c1-4b16-a8f6-9f4a39538e97 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 5db3a24e-6641-4f79-9d50-6b97b67ea6a9] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:25.741728 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b3822668-d8c1-4b16-a8f6-9f4a39538e97 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:25.742445 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b3822668-d8c1-4b16-a8f6-9f4a39538e97 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:25.744445 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b3822668-d8c1-4b16-a8f6-9f4a39538e97 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:25.745116 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b3822668-d8c1-4b16-a8f6-9f4a39538e97 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:25.883657 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.objects.instance [None req-b3822668-d8c1-4b16-a8f6-9f4a39538e97 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lazy-loading 'services' on Instance uuid 5db3a24e-6641-4f79-9d50-6b97b67ea6a9 {{(pid=116386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 03 02:58:26.015417 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-b3822668-d8c1-4b16-a8f6-9f4a39538e97 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "DELETE /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9/os-volume_attachments/14bfac71-0fb8-4333-87c3-fa7751c982ea" status: 202 len: 0 microversion: 2.1 time: 0.297000 Feb 03 02:58:26.018969 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 188/373] 10.222.0.31 () {58 vars in 1415 bytes} [Thu Feb 3 02:58:25 2022] DELETE /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9/os-volume_attachments/14bfac71-0fb8-4333-87c3-fa7751c982ea => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 03 02:58:26.029002 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-07fd9189-feb0-4814-82ff-646af1b04c58 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:26.030260 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-07fd9189-feb0-4814-82ff-646af1b04c58 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 5db3a24e-6641-4f79-9d50-6b97b67ea6a9] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:26.042755 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-07fd9189-feb0-4814-82ff-646af1b04c58 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:26.043290 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-07fd9189-feb0-4814-82ff-646af1b04c58 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:26.048773 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-07fd9189-feb0-4814-82ff-646af1b04c58 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:26.049223 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-07fd9189-feb0-4814-82ff-646af1b04c58 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:26.117838 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-07fd9189-feb0-4814-82ff-646af1b04c58 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094395 Feb 03 02:58:26.118436 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 186/374] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Feb 3 02:58:26 2022] GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:58:26.209850 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-d3dedab7-0b8a-4c72-84cb-729d5b0dc0e3 req-2d533d80-e77d-41be-9d3d-53b36ff8c09c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0708ed4-206d-484e-a2b4-dfb7733d415b", "name": "network-vif-plugged", "status": "completed", "tag": "27c8015c-4643-475a-85ae-a540d30129eb"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:58:26.211789 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:58:26.211789 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 02:58:26.232917 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-d3dedab7-0b8a-4c72-84cb-729d5b0dc0e3 req-2d533d80-e77d-41be-9d3d-53b36ff8c09c service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:26.232917 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-d3dedab7-0b8a-4c72-84cb-729d5b0dc0e3 req-2d533d80-e77d-41be-9d3d-53b36ff8c09c service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:26.263643 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-d3dedab7-0b8a-4c72-84cb-729d5b0dc0e3 req-2d533d80-e77d-41be-9d3d-53b36ff8c09c service nova] Creating event network-vif-plugged:27c8015c-4643-475a-85ae-a540d30129eb for instance e0708ed4-206d-484e-a2b4-dfb7733d415b on hv-cinder-82758 Feb 03 02:58:26.277321 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-d3dedab7-0b8a-4c72-84cb-729d5b0dc0e3 req-2d533d80-e77d-41be-9d3d-53b36ff8c09c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071442 Feb 03 02:58:26.278014 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 189/375] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:58:26.365349 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-24879afe-a7d7-457c-b14b-b3612d56ff60 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:26.366286 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-24879afe-a7d7-457c-b14b-b3612d56ff60 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:26.381637 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-24879afe-a7d7-457c-b14b-b3612d56ff60 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:26.382279 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-24879afe-a7d7-457c-b14b-b3612d56ff60 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:26.383172 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-24879afe-a7d7-457c-b14b-b3612d56ff60 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:26.384114 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-24879afe-a7d7-457c-b14b-b3612d56ff60 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:26.506904 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-7ffabe03-fed6-464b-a4ba-b655d39742c9 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:26.508158 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-7ffabe03-fed6-464b-a4ba-b655d39742c9 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:26.514478 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7ffabe03-fed6-464b-a4ba-b655d39742c9 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:26.515229 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7ffabe03-fed6-464b-a4ba-b655d39742c9 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:26.516254 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7ffabe03-fed6-464b-a4ba-b655d39742c9 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:26.517048 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7ffabe03-fed6-464b-a4ba-b655d39742c9 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:26.857405 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-24879afe-a7d7-457c-b14b-b3612d56ff60 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:26.872270 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-24879afe-a7d7-457c-b14b-b3612d56ff60 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:26.878895 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-24879afe-a7d7-457c-b14b-b3612d56ff60 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:26.880589 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-24879afe-a7d7-457c-b14b-b3612d56ff60 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1407 microversion: 2.20 time: 0.520387 Feb 03 02:58:26.884027 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 187/376] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 02:58:26 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1407 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 02:58:26.914735 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-7ffabe03-fed6-464b-a4ba-b655d39742c9 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:26.926553 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-7ffabe03-fed6-464b-a4ba-b655d39742c9 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1519 microversion: 2.1 time: 0.423505 Feb 03 02:58:26.927787 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 190/377] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:26 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1519 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:27.131227 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-f49d9a10-d547-44ba-b850-09910e406f5d tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:27.135451 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-f49d9a10-d547-44ba-b850-09910e406f5d tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 5db3a24e-6641-4f79-9d50-6b97b67ea6a9] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:27.143961 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f49d9a10-d547-44ba-b850-09910e406f5d tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:27.144705 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f49d9a10-d547-44ba-b850-09910e406f5d tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:27.145671 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f49d9a10-d547-44ba-b850-09910e406f5d tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:27.146253 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f49d9a10-d547-44ba-b850-09910e406f5d tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:27.197236 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-f49d9a10-d547-44ba-b850-09910e406f5d tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071074 Feb 03 02:58:27.198597 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 188/378] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Feb 3 02:58:27 2022] GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 03 02:58:27.899293 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-13a2eaa7-3b2c-40be-a7c3-51732bce2516 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:27.900232 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-13a2eaa7-3b2c-40be-a7c3-51732bce2516 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:27.917445 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-13a2eaa7-3b2c-40be-a7c3-51732bce2516 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:27.920051 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-13a2eaa7-3b2c-40be-a7c3-51732bce2516 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:27.923720 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-13a2eaa7-3b2c-40be-a7c3-51732bce2516 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:27.926206 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-13a2eaa7-3b2c-40be-a7c3-51732bce2516 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:27.943825 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-4f7f3b99-826a-44f1-bd6a-942ad328adb5 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:27.945005 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-4f7f3b99-826a-44f1-bd6a-942ad328adb5 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:27.961978 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4f7f3b99-826a-44f1-bd6a-942ad328adb5 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:27.970543 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4f7f3b99-826a-44f1-bd6a-942ad328adb5 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:27.973760 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4f7f3b99-826a-44f1-bd6a-942ad328adb5 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:27.974425 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4f7f3b99-826a-44f1-bd6a-942ad328adb5 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:28.246186 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-13a2eaa7-3b2c-40be-a7c3-51732bce2516 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:28.265916 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-13a2eaa7-3b2c-40be-a7c3-51732bce2516 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:28.272496 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-13a2eaa7-3b2c-40be-a7c3-51732bce2516 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:28.274754 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-13a2eaa7-3b2c-40be-a7c3-51732bce2516 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1407 microversion: 2.20 time: 0.379252 Feb 03 02:58:28.300603 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 191/379] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 02:58:27 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1407 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 02:58:28.306272 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-7324e08c-5bc6-4a48-8c57-7e82b21b1066 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:28.307516 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-7324e08c-5bc6-4a48-8c57-7e82b21b1066 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 5db3a24e-6641-4f79-9d50-6b97b67ea6a9] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:28.314903 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7324e08c-5bc6-4a48-8c57-7e82b21b1066 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:28.315705 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7324e08c-5bc6-4a48-8c57-7e82b21b1066 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:28.317054 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7324e08c-5bc6-4a48-8c57-7e82b21b1066 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:28.317784 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7324e08c-5bc6-4a48-8c57-7e82b21b1066 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:28.357157 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-4f7f3b99-826a-44f1-bd6a-942ad328adb5 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:28.365703 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-4f7f3b99-826a-44f1-bd6a-942ad328adb5 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1519 microversion: 2.1 time: 0.425497 Feb 03 02:58:28.366981 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 189/380] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:27 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1519 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:28.403884 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-7324e08c-5bc6-4a48-8c57-7e82b21b1066 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.101667 Feb 03 02:58:28.404783 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 192/381] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Feb 3 02:58:28 2022] GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9/os-volume_attachments => generated 25 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 03 02:58:28.665859 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-1eec8136-2966-4536-a054-2817005f72b6 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1631062910", "imageRef": "99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce", "flavorRef": "452", "networks": [{"uuid": "126c5997-2080-4b93-9c71-959073b0550c"}]}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:58:29.308903 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-49f9ef27-42ae-4b4e-9b62-37e7bcfa5004 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:29.309406 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-49f9ef27-42ae-4b4e-9b62-37e7bcfa5004 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:29.316383 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-49f9ef27-42ae-4b4e-9b62-37e7bcfa5004 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:29.316855 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-49f9ef27-42ae-4b4e-9b62-37e7bcfa5004 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:29.317624 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-49f9ef27-42ae-4b4e-9b62-37e7bcfa5004 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:29.318054 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-49f9ef27-42ae-4b4e-9b62-37e7bcfa5004 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:29.611414 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-49f9ef27-42ae-4b4e-9b62-37e7bcfa5004 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:29.627050 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-49f9ef27-42ae-4b4e-9b62-37e7bcfa5004 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:29.629854 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-49f9ef27-42ae-4b4e-9b62-37e7bcfa5004 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:29.632109 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-49f9ef27-42ae-4b4e-9b62-37e7bcfa5004 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1598 microversion: 2.20 time: 0.328501 Feb 03 02:58:29.634652 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 193/382] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 02:58:29 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1598 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 03 02:58:29.640279 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-f87fb61b-9493-4779-9a7d-4d9be95da124 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:29.641564 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-f87fb61b-9493-4779-9a7d-4d9be95da124 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:29.650652 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f87fb61b-9493-4779-9a7d-4d9be95da124 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:29.652075 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f87fb61b-9493-4779-9a7d-4d9be95da124 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:29.653313 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f87fb61b-9493-4779-9a7d-4d9be95da124 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:29.654176 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f87fb61b-9493-4779-9a7d-4d9be95da124 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:29.953918 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-f87fb61b-9493-4779-9a7d-4d9be95da124 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:29.962967 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-f87fb61b-9493-4779-9a7d-4d9be95da124 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1519 microversion: 2.1 time: 0.326946 Feb 03 02:58:29.976996 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 194/383] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:29 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1519 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:29.981078 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-877633ef-b348-4c9f-a918-70c0877d8741 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:29.984145 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-877633ef-b348-4c9f-a918-70c0877d8741 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:29.992426 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-877633ef-b348-4c9f-a918-70c0877d8741 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:29.992961 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-877633ef-b348-4c9f-a918-70c0877d8741 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:29.993858 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-877633ef-b348-4c9f-a918-70c0877d8741 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:29.994351 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-877633ef-b348-4c9f-a918-70c0877d8741 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:30.103444 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-877633ef-b348-4c9f-a918-70c0877d8741 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.129111 Feb 03 02:58:30.104568 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 195/384] 10.222.0.31 () {60 vars in 1315 bytes} [Thu Feb 3 02:58:29 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 03 02:58:30.979873 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-ab3d0436-7d27-48b5-a636-ddf302a67ffc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:30.981510 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-ab3d0436-7d27-48b5-a636-ddf302a67ffc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:30.994600 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ab3d0436-7d27-48b5-a636-ddf302a67ffc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:30.995358 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ab3d0436-7d27-48b5-a636-ddf302a67ffc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:31.002111 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ab3d0436-7d27-48b5-a636-ddf302a67ffc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:31.002875 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ab3d0436-7d27-48b5-a636-ddf302a67ffc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:31.306282 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-ab3d0436-7d27-48b5-a636-ddf302a67ffc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:31.320109 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-ab3d0436-7d27-48b5-a636-ddf302a67ffc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1519 microversion: 2.1 time: 0.341176 Feb 03 02:58:31.334911 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 196/385] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:30 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1519 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:31.689460 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-dd5a12cd-498e-4517-8205-eb528ff779ea tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:31.691121 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-dd5a12cd-498e-4517-8205-eb528ff779ea tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:31.703325 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-dd5a12cd-498e-4517-8205-eb528ff779ea tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:31.704115 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-dd5a12cd-498e-4517-8205-eb528ff779ea tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:31.705208 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-dd5a12cd-498e-4517-8205-eb528ff779ea tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:31.705855 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-dd5a12cd-498e-4517-8205-eb528ff779ea tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:31.881294 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-dd5a12cd-498e-4517-8205-eb528ff779ea tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:31.893220 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-dd5a12cd-498e-4517-8205-eb528ff779ea tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:31.896488 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-dd5a12cd-498e-4517-8205-eb528ff779ea tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:31.899221 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-dd5a12cd-498e-4517-8205-eb528ff779ea tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1598 microversion: 2.20 time: 0.212357 Feb 03 02:58:31.910073 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 197/386] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 02:58:31 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1598 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 03 02:58:31.918699 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-c87b9fae-5298-4702-a29d-16af6e9a0496 req-b19383ea-8d6d-4cea-81db-dd3e17e93494 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0708ed4-206d-484e-a2b4-dfb7733d415b", "tag": "27c8015c-4643-475a-85ae-a540d30129eb"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:58:31.920862 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:58:31.920862 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 02:58:31.932140 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-c87b9fae-5298-4702-a29d-16af6e9a0496 req-b19383ea-8d6d-4cea-81db-dd3e17e93494 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:31.932656 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-c87b9fae-5298-4702-a29d-16af6e9a0496 req-b19383ea-8d6d-4cea-81db-dd3e17e93494 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:31.945068 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-c87b9fae-5298-4702-a29d-16af6e9a0496 req-b19383ea-8d6d-4cea-81db-dd3e17e93494 service nova] Creating event network-changed:27c8015c-4643-475a-85ae-a540d30129eb for instance e0708ed4-206d-484e-a2b4-dfb7733d415b on hv-cinder-82758 Feb 03 02:58:31.950877 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-c87b9fae-5298-4702-a29d-16af6e9a0496 req-b19383ea-8d6d-4cea-81db-dd3e17e93494 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041160 Feb 03 02:58:31.951676 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 198/387] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:58:32.339128 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-a890065d-dc90-4b05-bd5c-c15373ffa0ab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:32.340568 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-a890065d-dc90-4b05-bd5c-c15373ffa0ab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:32.348185 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a890065d-dc90-4b05-bd5c-c15373ffa0ab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:32.349020 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a890065d-dc90-4b05-bd5c-c15373ffa0ab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:32.350100 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a890065d-dc90-4b05-bd5c-c15373ffa0ab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:32.350771 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a890065d-dc90-4b05-bd5c-c15373ffa0ab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:32.609924 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-a890065d-dc90-4b05-bd5c-c15373ffa0ab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:32.618986 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-a890065d-dc90-4b05-bd5c-c15373ffa0ab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1519 microversion: 2.1 time: 0.285281 Feb 03 02:58:32.620192 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 199/388] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:32 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1519 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:58:32.625371 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-fa075aac-fa23-420e-b699-31835859b58d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4af57d0e-9004-4664-b9e1-491119ef4414"}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:58:32.626726 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-fa075aac-fa23-420e-b699-31835859b58d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:32.633989 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fa075aac-fa23-420e-b699-31835859b58d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:32.634678 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fa075aac-fa23-420e-b699-31835859b58d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:32.635806 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fa075aac-fa23-420e-b699-31835859b58d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:32.640890 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fa075aac-fa23-420e-b699-31835859b58d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:33.009341 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-fa075aac-fa23-420e-b699-31835859b58d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "POST /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.386744 Feb 03 02:58:33.010448 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 200/389] 10.222.0.31 () {60 vars in 1322 bytes} [Thu Feb 3 02:58:32 2022] POST /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c/os-volume_attachments => generated 194 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:58:33.030343 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-ea438ce8-e811-4324-86ed-c52958e8b954 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:33.035046 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-ea438ce8-e811-4324-86ed-c52958e8b954 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:33.044231 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ea438ce8-e811-4324-86ed-c52958e8b954 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:33.045093 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ea438ce8-e811-4324-86ed-c52958e8b954 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:33.046122 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ea438ce8-e811-4324-86ed-c52958e8b954 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:33.046716 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ea438ce8-e811-4324-86ed-c52958e8b954 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:33.288329 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-ea438ce8-e811-4324-86ed-c52958e8b954 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:33.296923 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-ea438ce8-e811-4324-86ed-c52958e8b954 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:33.298650 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-ea438ce8-e811-4324-86ed-c52958e8b954 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:33.300009 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-ea438ce8-e811-4324-86ed-c52958e8b954 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1598 microversion: 2.20 time: 0.288036 Feb 03 02:58:33.300389 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 201/390] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 02:58:33 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1598 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 02:58:33.639202 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-a89b25fa-7317-4d31-9541-7c918db6f912 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:33.639980 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-a89b25fa-7317-4d31-9541-7c918db6f912 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:33.646617 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a89b25fa-7317-4d31-9541-7c918db6f912 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:33.647066 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a89b25fa-7317-4d31-9541-7c918db6f912 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:33.647820 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a89b25fa-7317-4d31-9541-7c918db6f912 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:33.648318 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a89b25fa-7317-4d31-9541-7c918db6f912 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:33.791251 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-a89b25fa-7317-4d31-9541-7c918db6f912 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:33.799169 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-a89b25fa-7317-4d31-9541-7c918db6f912 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1519 microversion: 2.1 time: 0.163791 Feb 03 02:58:33.799881 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 202/391] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:33 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:34.319805 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-d40efd62-eb75-42ad-b318-540fae7cb4f1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:34.321395 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-d40efd62-eb75-42ad-b318-540fae7cb4f1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:34.329711 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d40efd62-eb75-42ad-b318-540fae7cb4f1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:34.330244 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d40efd62-eb75-42ad-b318-540fae7cb4f1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:34.331105 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d40efd62-eb75-42ad-b318-540fae7cb4f1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:34.331600 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d40efd62-eb75-42ad-b318-540fae7cb4f1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:34.512148 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-d40efd62-eb75-42ad-b318-540fae7cb4f1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:34.520062 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-d40efd62-eb75-42ad-b318-540fae7cb4f1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:34.521577 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-d40efd62-eb75-42ad-b318-540fae7cb4f1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:34.522717 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-d40efd62-eb75-42ad-b318-540fae7cb4f1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1717 microversion: 2.20 time: 0.208939 Feb 03 02:58:34.523269 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 203/392] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 02:58:34 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1717 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 02:58:34.539222 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-6d85c66b-11a0-4b46-a146-631fb7aa054b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:34.539712 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-6d85c66b-11a0-4b46-a146-631fb7aa054b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:34.545412 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6d85c66b-11a0-4b46-a146-631fb7aa054b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:34.545859 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6d85c66b-11a0-4b46-a146-631fb7aa054b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:34.546635 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6d85c66b-11a0-4b46-a146-631fb7aa054b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:34.547068 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6d85c66b-11a0-4b46-a146-631fb7aa054b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:34.571073 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-6d85c66b-11a0-4b46-a146-631fb7aa054b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b/ips" status: 200 len: 151 microversion: 2.20 time: 0.035073 Feb 03 02:58:34.571747 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 204/393] 10.222.0.31 () {60 vars in 1288 bytes} [Thu Feb 3 02:58:34 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 03 02:58:34.819487 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-f6c1ebac-561e-498b-8f01-810413c11f32 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:34.820963 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-f6c1ebac-561e-498b-8f01-810413c11f32 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:34.835525 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f6c1ebac-561e-498b-8f01-810413c11f32 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:34.835702 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f6c1ebac-561e-498b-8f01-810413c11f32 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:34.836765 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f6c1ebac-561e-498b-8f01-810413c11f32 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:34.839041 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f6c1ebac-561e-498b-8f01-810413c11f32 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:35.005711 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-f6c1ebac-561e-498b-8f01-810413c11f32 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:35.013304 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-f6c1ebac-561e-498b-8f01-810413c11f32 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1519 microversion: 2.1 time: 0.198934 Feb 03 02:58:35.013868 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 205/394] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:34 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1519 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:36.031143 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-5c4de5cb-1063-4424-9428-4909f0caeabd tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:36.032108 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-5c4de5cb-1063-4424-9428-4909f0caeabd tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:36.039050 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5c4de5cb-1063-4424-9428-4909f0caeabd tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:36.039736 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5c4de5cb-1063-4424-9428-4909f0caeabd tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:36.040560 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5c4de5cb-1063-4424-9428-4909f0caeabd tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:36.041226 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5c4de5cb-1063-4424-9428-4909f0caeabd tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:36.226639 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-5c4de5cb-1063-4424-9428-4909f0caeabd tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:36.249628 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-5c4de5cb-1063-4424-9428-4909f0caeabd tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1519 microversion: 2.1 time: 0.222335 Feb 03 02:58:36.263220 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 206/395] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:36 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1519 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:37.270756 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-869137eb-e567-426e-a019-ee516fa24580 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:37.272302 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-869137eb-e567-426e-a019-ee516fa24580 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:37.280138 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-869137eb-e567-426e-a019-ee516fa24580 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:37.280930 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-869137eb-e567-426e-a019-ee516fa24580 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:37.281836 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-869137eb-e567-426e-a019-ee516fa24580 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:37.282466 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-869137eb-e567-426e-a019-ee516fa24580 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:37.427938 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-869137eb-e567-426e-a019-ee516fa24580 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:37.435757 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-869137eb-e567-426e-a019-ee516fa24580 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1519 microversion: 2.1 time: 0.168903 Feb 03 02:58:37.436356 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 207/396] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:37 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:58:38.453138 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-5268de31-ea8f-4e93-8a8f-6f6cf9ef1de3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:38.453809 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-5268de31-ea8f-4e93-8a8f-6f6cf9ef1de3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:38.460661 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5268de31-ea8f-4e93-8a8f-6f6cf9ef1de3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:38.461144 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5268de31-ea8f-4e93-8a8f-6f6cf9ef1de3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:38.461999 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5268de31-ea8f-4e93-8a8f-6f6cf9ef1de3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:38.462460 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5268de31-ea8f-4e93-8a8f-6f6cf9ef1de3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:38.613968 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-5268de31-ea8f-4e93-8a8f-6f6cf9ef1de3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:38.621945 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-5268de31-ea8f-4e93-8a8f-6f6cf9ef1de3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1519 microversion: 2.1 time: 0.172565 Feb 03 02:58:38.622468 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 208/397] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:38 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:58:39.639835 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-c636f241-367e-4852-bdf3-ea190ac25215 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:39.640544 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-c636f241-367e-4852-bdf3-ea190ac25215 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:39.646977 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c636f241-367e-4852-bdf3-ea190ac25215 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:39.647420 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c636f241-367e-4852-bdf3-ea190ac25215 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:39.648199 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c636f241-367e-4852-bdf3-ea190ac25215 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:39.648926 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c636f241-367e-4852-bdf3-ea190ac25215 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:39.791198 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-c636f241-367e-4852-bdf3-ea190ac25215 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:39.799155 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-c636f241-367e-4852-bdf3-ea190ac25215 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1519 microversion: 2.1 time: 0.163579 Feb 03 02:58:39.800249 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 209/398] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:39 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:40.605900 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-3445e1f3-b1b9-4f17-a94d-50847a1fe2aa tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:58:40.615855 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3445e1f3-b1b9-4f17-a94d-50847a1fe2aa tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:40.616697 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3445e1f3-b1b9-4f17-a94d-50847a1fe2aa tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:40.682241 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-3445e1f3-b1b9-4f17-a94d-50847a1fe2aa tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Going to try to stop instance {{(pid=116386) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Feb 03 02:58:40.738507 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-3445e1f3-b1b9-4f17-a94d-50847a1fe2aa tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "POST /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c/action" status: 202 len: 0 microversion: 2.1 time: 0.138250 Feb 03 02:58:40.739315 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 210/399] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Feb 3 02:58:40 2022] POST /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 03 02:58:40.749848 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-403a7e90-46da-4c2b-8b7d-ccf3358f873e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:40.750589 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-403a7e90-46da-4c2b-8b7d-ccf3358f873e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:40.758220 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-403a7e90-46da-4c2b-8b7d-ccf3358f873e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:40.759182 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-403a7e90-46da-4c2b-8b7d-ccf3358f873e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:40.760198 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-403a7e90-46da-4c2b-8b7d-ccf3358f873e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:40.760988 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-403a7e90-46da-4c2b-8b7d-ccf3358f873e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:41.009301 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-403a7e90-46da-4c2b-8b7d-ccf3358f873e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:41.017939 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-403a7e90-46da-4c2b-8b7d-ccf3358f873e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1725 microversion: 2.1 time: 0.273484 Feb 03 02:58:41.018563 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 211/400] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:40 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1725 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:58:41.033216 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-41550042-a207-4759-8396-ef26c19b7fce tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:41.033868 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-41550042-a207-4759-8396-ef26c19b7fce tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:41.040510 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-41550042-a207-4759-8396-ef26c19b7fce tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:41.041030 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-41550042-a207-4759-8396-ef26c19b7fce tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:41.041858 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-41550042-a207-4759-8396-ef26c19b7fce tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:41.042316 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-41550042-a207-4759-8396-ef26c19b7fce tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:41.298624 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-41550042-a207-4759-8396-ef26c19b7fce tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:41.308057 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-41550042-a207-4759-8396-ef26c19b7fce tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1519 microversion: 2.1 time: 0.278327 Feb 03 02:58:41.319624 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 212/401] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:41 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1519 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:42.035342 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-ae09affd-27a9-4b67-b771-c1ca01e0c91b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:42.036053 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-ae09affd-27a9-4b67-b771-c1ca01e0c91b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:42.042594 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ae09affd-27a9-4b67-b771-c1ca01e0c91b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:42.043035 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ae09affd-27a9-4b67-b771-c1ca01e0c91b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:42.043830 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ae09affd-27a9-4b67-b771-c1ca01e0c91b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:42.044298 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ae09affd-27a9-4b67-b771-c1ca01e0c91b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:42.211964 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-ae09affd-27a9-4b67-b771-c1ca01e0c91b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:42.228488 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-ae09affd-27a9-4b67-b771-c1ca01e0c91b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1725 microversion: 2.1 time: 0.196700 Feb 03 02:58:42.229291 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 213/402] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:42 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:42.327702 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-c38a5ab3-4059-4d2a-b3ca-f09756a916a1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:42.328874 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-c38a5ab3-4059-4d2a-b3ca-f09756a916a1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:42.336111 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c38a5ab3-4059-4d2a-b3ca-f09756a916a1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:42.336890 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c38a5ab3-4059-4d2a-b3ca-f09756a916a1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:42.337718 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c38a5ab3-4059-4d2a-b3ca-f09756a916a1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:42.338279 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c38a5ab3-4059-4d2a-b3ca-f09756a916a1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:42.544513 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-c38a5ab3-4059-4d2a-b3ca-f09756a916a1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:42.556080 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-c38a5ab3-4059-4d2a-b3ca-f09756a916a1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1519 microversion: 2.1 time: 0.232798 Feb 03 02:58:42.556668 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 214/403] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:42 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1519 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:43.248089 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-1cd4379d-2a48-4ac4-beac-a34073c50140 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:43.248957 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-1cd4379d-2a48-4ac4-beac-a34073c50140 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:43.256630 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1cd4379d-2a48-4ac4-beac-a34073c50140 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:43.257664 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1cd4379d-2a48-4ac4-beac-a34073c50140 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:43.258670 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1cd4379d-2a48-4ac4-beac-a34073c50140 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:43.259242 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1cd4379d-2a48-4ac4-beac-a34073c50140 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:43.411347 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-1cd4379d-2a48-4ac4-beac-a34073c50140 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:43.419903 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-1cd4379d-2a48-4ac4-beac-a34073c50140 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1725 microversion: 2.1 time: 0.176995 Feb 03 02:58:43.420493 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 215/404] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:43 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:58:43.573431 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-d7c5eec5-6eeb-45a9-8b26-7975bab2b137 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:43.574132 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-d7c5eec5-6eeb-45a9-8b26-7975bab2b137 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:43.580068 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d7c5eec5-6eeb-45a9-8b26-7975bab2b137 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:43.580510 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d7c5eec5-6eeb-45a9-8b26-7975bab2b137 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:43.581317 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d7c5eec5-6eeb-45a9-8b26-7975bab2b137 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:43.581774 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d7c5eec5-6eeb-45a9-8b26-7975bab2b137 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:43.729181 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-d7c5eec5-6eeb-45a9-8b26-7975bab2b137 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:43.736685 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-d7c5eec5-6eeb-45a9-8b26-7975bab2b137 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1519 microversion: 2.1 time: 0.167282 Feb 03 02:58:43.737266 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 216/405] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:43 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:58:44.437685 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-85db401c-a54e-47ac-87fa-f839e498a958 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:44.438393 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-85db401c-a54e-47ac-87fa-f839e498a958 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:44.445694 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-85db401c-a54e-47ac-87fa-f839e498a958 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:44.446151 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-85db401c-a54e-47ac-87fa-f839e498a958 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:44.447338 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-85db401c-a54e-47ac-87fa-f839e498a958 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:44.447835 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-85db401c-a54e-47ac-87fa-f839e498a958 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:44.602884 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-85db401c-a54e-47ac-87fa-f839e498a958 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:44.612266 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-85db401c-a54e-47ac-87fa-f839e498a958 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1725 microversion: 2.1 time: 0.178405 Feb 03 02:58:44.621875 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 217/406] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:44 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:44.754338 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-cae3634b-7049-4a6c-b435-0da905dcdfaa tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:44.754852 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-cae3634b-7049-4a6c-b435-0da905dcdfaa tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:44.762620 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cae3634b-7049-4a6c-b435-0da905dcdfaa tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:44.762620 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cae3634b-7049-4a6c-b435-0da905dcdfaa tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:44.762620 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cae3634b-7049-4a6c-b435-0da905dcdfaa tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:44.762956 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cae3634b-7049-4a6c-b435-0da905dcdfaa tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:44.920932 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-cae3634b-7049-4a6c-b435-0da905dcdfaa tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:44.929916 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-cae3634b-7049-4a6c-b435-0da905dcdfaa tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1519 microversion: 2.1 time: 0.179290 Feb 03 02:58:44.930798 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 218/407] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:44 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1519 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:45.629993 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-03b9178d-bb11-49b2-995d-8f081ee5a505 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:45.630681 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-03b9178d-bb11-49b2-995d-8f081ee5a505 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:45.638152 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-03b9178d-bb11-49b2-995d-8f081ee5a505 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:45.638317 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-03b9178d-bb11-49b2-995d-8f081ee5a505 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:45.639230 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-03b9178d-bb11-49b2-995d-8f081ee5a505 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:45.639666 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-03b9178d-bb11-49b2-995d-8f081ee5a505 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:45.787051 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-03b9178d-bb11-49b2-995d-8f081ee5a505 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:45.795704 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-03b9178d-bb11-49b2-995d-8f081ee5a505 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1725 microversion: 2.1 time: 0.170212 Feb 03 02:58:45.796315 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 219/408] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:45 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:58:45.947158 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-8c3f40b3-0009-4350-bc8a-c2b0631c9d4c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:45.947752 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-8c3f40b3-0009-4350-bc8a-c2b0631c9d4c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:45.954812 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8c3f40b3-0009-4350-bc8a-c2b0631c9d4c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:45.955237 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8c3f40b3-0009-4350-bc8a-c2b0631c9d4c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:45.956287 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8c3f40b3-0009-4350-bc8a-c2b0631c9d4c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:45.956761 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8c3f40b3-0009-4350-bc8a-c2b0631c9d4c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:46.103879 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-8c3f40b3-0009-4350-bc8a-c2b0631c9d4c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:46.112217 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-8c3f40b3-0009-4350-bc8a-c2b0631c9d4c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1519 microversion: 2.1 time: 0.168741 Feb 03 02:58:46.112909 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 220/409] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:45 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:46.751765 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.network.neutron [None req-1eec8136-2966-4536-a054-2817005f72b6 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] validate_networks() for [('126c5997-2080-4b93-9c71-959073b0550c', None, None, None, None, None)] {{(pid=116385) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 03 02:58:46.813385 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-2a1dae56-ac46-4b29-bce7-7ea5c6931fd6 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:46.814037 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-2a1dae56-ac46-4b29-bce7-7ea5c6931fd6 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:46.821252 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2a1dae56-ac46-4b29-bce7-7ea5c6931fd6 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:46.821834 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2a1dae56-ac46-4b29-bce7-7ea5c6931fd6 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:46.823035 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2a1dae56-ac46-4b29-bce7-7ea5c6931fd6 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:46.823391 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2a1dae56-ac46-4b29-bce7-7ea5c6931fd6 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:47.034123 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-2a1dae56-ac46-4b29-bce7-7ea5c6931fd6 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:47.044751 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-2a1dae56-ac46-4b29-bce7-7ea5c6931fd6 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1725 microversion: 2.1 time: 0.235553 Feb 03 02:58:47.045372 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 221/410] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:46 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1725 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:47.129773 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-389ff3f9-0c44-4507-bb7c-b55d7bc4aba3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:47.130135 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-389ff3f9-0c44-4507-bb7c-b55d7bc4aba3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:47.136203 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-389ff3f9-0c44-4507-bb7c-b55d7bc4aba3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:47.136669 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-389ff3f9-0c44-4507-bb7c-b55d7bc4aba3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:47.137506 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-389ff3f9-0c44-4507-bb7c-b55d7bc4aba3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:47.137899 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-389ff3f9-0c44-4507-bb7c-b55d7bc4aba3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:47.272585 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-1eec8136-2966-4536-a054-2817005f72b6 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Flavor limits 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 03 02:58:47.273107 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-1eec8136-2966-4536-a054-2817005f72b6 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Image limits 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 03 02:58:47.273639 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-1eec8136-2966-4536-a054-2817005f72b6 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Flavor pref 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 03 02:58:47.274111 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-1eec8136-2966-4536-a054-2817005f72b6 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Image pref 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 03 02:58:47.274689 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-1eec8136-2966-4536-a054-2817005f72b6 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 03 02:58:47.283781 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1eec8136-2966-4536-a054-2817005f72b6 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:47.284222 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1eec8136-2966-4536-a054-2817005f72b6 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:47.285114 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1eec8136-2966-4536-a054-2817005f72b6 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:47.285662 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1eec8136-2966-4536-a054-2817005f72b6 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:47.303923 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-1eec8136-2966-4536-a054-2817005f72b6 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Getting quotas for project ff777728bb704feeabf264e753679daa. Resources: {'cores', 'ram', 'instances'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 02:58:47.307915 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-1eec8136-2966-4536-a054-2817005f72b6 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Getting quotas for user 087b5f4f3891413b8b7fa727768c09a4 and project ff777728bb704feeabf264e753679daa. Resources: {'cores', 'ram', 'instances'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 02:58:47.319137 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-1eec8136-2966-4536-a054-2817005f72b6 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Going to run 1 instances... {{(pid=116385) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 03 02:58:47.321529 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-1eec8136-2966-4536-a054-2817005f72b6 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: d861e845-ecc7-4b5a-85a6-71a9af607f86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 03 02:58:47.329241 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-389ff3f9-0c44-4507-bb7c-b55d7bc4aba3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:47.337244 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-389ff3f9-0c44-4507-bb7c-b55d7bc4aba3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1519 microversion: 2.1 time: 0.211425 Feb 03 02:58:47.337819 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 222/411] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:47 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1519 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:58:47.369254 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-1eec8136-2966-4536-a054-2817005f72b6 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 18.706889 Feb 03 02:58:47.370121 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 190/412] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Feb 3 02:58:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 18709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 03 02:58:47.381541 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-f97e981f-933c-463f-91c6-ec13dd924e74 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:47.382144 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-f97e981f-933c-463f-91c6-ec13dd924e74 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: d861e845-ecc7-4b5a-85a6-71a9af607f86] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:47.446654 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-f97e981f-933c-463f-91c6-ec13dd924e74 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:47.455909 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-f97e981f-933c-463f-91c6-ec13dd924e74 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86" status: 200 len: 1218 microversion: 2.1 time: 0.078871 Feb 03 02:58:47.459369 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 223/413] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:47 2022] GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:48.062058 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-85da4b86-857a-49bd-8880-a24f1473d65f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:48.063722 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-85da4b86-857a-49bd-8880-a24f1473d65f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:48.070605 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-85da4b86-857a-49bd-8880-a24f1473d65f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:48.071391 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-85da4b86-857a-49bd-8880-a24f1473d65f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:48.074793 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-85da4b86-857a-49bd-8880-a24f1473d65f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:48.075241 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-85da4b86-857a-49bd-8880-a24f1473d65f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:48.216475 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-85da4b86-857a-49bd-8880-a24f1473d65f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:48.225508 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-85da4b86-857a-49bd-8880-a24f1473d65f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1725 microversion: 2.1 time: 0.167331 Feb 03 02:58:48.226082 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 191/414] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:48 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:48.354842 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-8c7e21af-bd2d-4585-9271-d6c3981f4a8a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:48.355433 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-8c7e21af-bd2d-4585-9271-d6c3981f4a8a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:48.362447 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8c7e21af-bd2d-4585-9271-d6c3981f4a8a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:48.363077 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8c7e21af-bd2d-4585-9271-d6c3981f4a8a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:48.364101 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8c7e21af-bd2d-4585-9271-d6c3981f4a8a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:48.364529 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8c7e21af-bd2d-4585-9271-d6c3981f4a8a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:48.490936 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-0441767b-0533-40ee-b740-7243662661c2 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:48.491876 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-0441767b-0533-40ee-b740-7243662661c2 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: d861e845-ecc7-4b5a-85a6-71a9af607f86] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:48.499895 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0441767b-0533-40ee-b740-7243662661c2 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:48.500664 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0441767b-0533-40ee-b740-7243662661c2 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:48.501685 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0441767b-0533-40ee-b740-7243662661c2 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:48.502332 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0441767b-0533-40ee-b740-7243662661c2 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:48.580382 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-8c7e21af-bd2d-4585-9271-d6c3981f4a8a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:48.581053 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-0441767b-0533-40ee-b740-7243662661c2 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:48.588966 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-0441767b-0533-40ee-b740-7243662661c2 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86" status: 200 len: 1270 microversion: 2.1 time: 0.114808 Feb 03 02:58:48.591903 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 192/415] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:48 2022] GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86 => generated 1270 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:48.602360 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-8c7e21af-bd2d-4585-9271-d6c3981f4a8a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1519 microversion: 2.1 time: 0.246838 Feb 03 02:58:48.614714 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 224/416] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:48 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1519 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:49.242695 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-c0cf796a-e25a-4fca-bad2-51afedad0c5f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:49.243936 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-c0cf796a-e25a-4fca-bad2-51afedad0c5f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:49.250689 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c0cf796a-e25a-4fca-bad2-51afedad0c5f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:49.251136 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c0cf796a-e25a-4fca-bad2-51afedad0c5f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:49.251920 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c0cf796a-e25a-4fca-bad2-51afedad0c5f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:49.252509 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c0cf796a-e25a-4fca-bad2-51afedad0c5f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:49.457772 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-c0cf796a-e25a-4fca-bad2-51afedad0c5f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:49.466592 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-c0cf796a-e25a-4fca-bad2-51afedad0c5f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1725 microversion: 2.1 time: 0.227956 Feb 03 02:58:49.480306 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 193/417] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:49 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1725 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:49.617514 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-c970c38a-3bd2-4750-bb68-48396de1eef5 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:49.618135 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-c970c38a-3bd2-4750-bb68-48396de1eef5 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: d861e845-ecc7-4b5a-85a6-71a9af607f86] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:49.632203 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-9356a1b3-7b63-4acf-bb3d-2a69ddabd3c8 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:49.633424 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-9356a1b3-7b63-4acf-bb3d-2a69ddabd3c8 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:49.641684 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9356a1b3-7b63-4acf-bb3d-2a69ddabd3c8 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:49.644385 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9356a1b3-7b63-4acf-bb3d-2a69ddabd3c8 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:49.646122 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9356a1b3-7b63-4acf-bb3d-2a69ddabd3c8 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:49.646820 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9356a1b3-7b63-4acf-bb3d-2a69ddabd3c8 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:49.647606 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c970c38a-3bd2-4750-bb68-48396de1eef5 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:49.649929 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c970c38a-3bd2-4750-bb68-48396de1eef5 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:49.656173 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c970c38a-3bd2-4750-bb68-48396de1eef5 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:49.659568 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c970c38a-3bd2-4750-bb68-48396de1eef5 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:49.999850 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-9356a1b3-7b63-4acf-bb3d-2a69ddabd3c8 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:50.023041 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-9356a1b3-7b63-4acf-bb3d-2a69ddabd3c8 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1519 microversion: 2.1 time: 0.391391 Feb 03 02:58:50.028523 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 194/418] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:49 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1519 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:58:50.105396 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-c970c38a-3bd2-4750-bb68-48396de1eef5 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:50.119422 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-c970c38a-3bd2-4750-bb68-48396de1eef5 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86" status: 200 len: 1318 microversion: 2.1 time: 0.504248 Feb 03 02:58:50.120376 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 225/419] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:49 2022] GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86 => generated 1318 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:50.484286 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-58f0693f-15c8-44b3-b130-30a316257475 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:50.485412 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-58f0693f-15c8-44b3-b130-30a316257475 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:50.496680 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-58f0693f-15c8-44b3-b130-30a316257475 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:50.497278 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-58f0693f-15c8-44b3-b130-30a316257475 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:50.498895 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-58f0693f-15c8-44b3-b130-30a316257475 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:50.500771 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-58f0693f-15c8-44b3-b130-30a316257475 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:50.565279 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-69030765-2691-4295-95eb-a22e3b2da0c4 req-b7e0bdd9-49eb-4e1f-9ea8-91d4895283ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d861e845-ecc7-4b5a-85a6-71a9af607f86", "tag": "716697ab-7116-4750-bb15-40d6691bc75e"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:58:50.570182 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:58:50.570182 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 02:58:50.585036 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-69030765-2691-4295-95eb-a22e3b2da0c4 req-b7e0bdd9-49eb-4e1f-9ea8-91d4895283ba service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:50.585842 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-69030765-2691-4295-95eb-a22e3b2da0c4 req-b7e0bdd9-49eb-4e1f-9ea8-91d4895283ba service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:50.603433 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-69030765-2691-4295-95eb-a22e3b2da0c4 req-b7e0bdd9-49eb-4e1f-9ea8-91d4895283ba service nova] Creating event network-changed:716697ab-7116-4750-bb15-40d6691bc75e for instance d861e845-ecc7-4b5a-85a6-71a9af607f86 on hv-cinder-82758 Feb 03 02:58:50.611559 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-69030765-2691-4295-95eb-a22e3b2da0c4 req-b7e0bdd9-49eb-4e1f-9ea8-91d4895283ba service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056769 Feb 03 02:58:50.612742 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 226/420] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 03 02:58:50.730396 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-58f0693f-15c8-44b3-b130-30a316257475 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:50.739534 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-58f0693f-15c8-44b3-b130-30a316257475 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1725 microversion: 2.1 time: 0.258649 Feb 03 02:58:50.741177 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 195/421] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:50 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1725 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:51.043373 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-aad65831-bc14-4008-bbde-5e415517f816 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:51.044944 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-aad65831-bc14-4008-bbde-5e415517f816 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:51.052005 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-aad65831-bc14-4008-bbde-5e415517f816 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:51.052945 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-aad65831-bc14-4008-bbde-5e415517f816 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:51.053995 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-aad65831-bc14-4008-bbde-5e415517f816 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:51.054757 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-aad65831-bc14-4008-bbde-5e415517f816 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:51.147861 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-d281d4aa-122a-4062-9554-3701df8ed1fb tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:51.148848 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-d281d4aa-122a-4062-9554-3701df8ed1fb tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: d861e845-ecc7-4b5a-85a6-71a9af607f86] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:51.167707 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d281d4aa-122a-4062-9554-3701df8ed1fb tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:51.168623 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d281d4aa-122a-4062-9554-3701df8ed1fb tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:51.171669 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d281d4aa-122a-4062-9554-3701df8ed1fb tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:51.172175 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d281d4aa-122a-4062-9554-3701df8ed1fb tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:51.355969 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-aad65831-bc14-4008-bbde-5e415517f816 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:51.364551 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-aad65831-bc14-4008-bbde-5e415517f816 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1499 microversion: 2.1 time: 0.325502 Feb 03 02:58:51.365852 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 227/422] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:51 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1499 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:51.383731 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-1491b986-2736-491f-81e9-bc794c8b673e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f94da37-e58e-4875-a535-36884e3e409b"}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:58:51.384944 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-1491b986-2736-491f-81e9-bc794c8b673e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:51.401001 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1491b986-2736-491f-81e9-bc794c8b673e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:51.401359 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1491b986-2736-491f-81e9-bc794c8b673e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:51.402407 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1491b986-2736-491f-81e9-bc794c8b673e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:51.402836 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1491b986-2736-491f-81e9-bc794c8b673e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:51.436451 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.wsgi [None req-1491b986-2736-491f-81e9-bc794c8b673e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] HTTP exception thrown: Cannot 'attach_volume' instance 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e while it is in vm_state rescued Feb 03 02:58:51.437075 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-1491b986-2736-491f-81e9-bc794c8b673e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Returning 409 to user: Cannot 'attach_volume' instance 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e while it is in vm_state rescued {{(pid=116386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 02:58:51.437933 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-1491b986-2736-491f-81e9-bc794c8b673e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "POST /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.059113 Feb 03 02:58:51.440867 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 228/423] 10.222.0.31 () {60 vars in 1322 bytes} [Thu Feb 3 02:58:51 2022] POST /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e/os-volume_attachments => generated 152 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Feb 03 02:58:51.447874 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-ad16dba7-f521-4610-81ff-25e1652780e9 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:58:51.448760 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-ad16dba7-f521-4610-81ff-25e1652780e9 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:51.454696 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ad16dba7-f521-4610-81ff-25e1652780e9 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:51.455129 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ad16dba7-f521-4610-81ff-25e1652780e9 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:51.455998 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ad16dba7-f521-4610-81ff-25e1652780e9 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:51.456425 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ad16dba7-f521-4610-81ff-25e1652780e9 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:51.504195 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-d281d4aa-122a-4062-9554-3701df8ed1fb tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:51.529567 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-d281d4aa-122a-4062-9554-3701df8ed1fb tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86" status: 200 len: 1318 microversion: 2.1 time: 0.395986 Feb 03 02:58:51.530789 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 196/424] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:51 2022] GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86 => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:58:51.559061 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-ad16dba7-f521-4610-81ff-25e1652780e9 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "POST /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e/action" status: 202 len: 0 microversion: 2.1 time: 0.115342 Feb 03 02:58:51.561208 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 229/425] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Feb 3 02:58:51 2022] POST /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 03 02:58:51.575912 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-9292d925-e1a1-48eb-a08b-73093f35e36d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:51.576951 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-9292d925-e1a1-48eb-a08b-73093f35e36d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:51.587335 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9292d925-e1a1-48eb-a08b-73093f35e36d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:51.588108 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9292d925-e1a1-48eb-a08b-73093f35e36d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:51.589504 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9292d925-e1a1-48eb-a08b-73093f35e36d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:51.590264 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9292d925-e1a1-48eb-a08b-73093f35e36d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:51.758490 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-409dc9dd-ba8c-42a2-8947-c41ac81ee883 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:51.759435 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-409dc9dd-ba8c-42a2-8947-c41ac81ee883 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:51.779492 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-409dc9dd-ba8c-42a2-8947-c41ac81ee883 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:51.780218 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-409dc9dd-ba8c-42a2-8947-c41ac81ee883 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:51.782023 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-409dc9dd-ba8c-42a2-8947-c41ac81ee883 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:51.782656 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-409dc9dd-ba8c-42a2-8947-c41ac81ee883 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:52.324887 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-9292d925-e1a1-48eb-a08b-73093f35e36d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:52.332562 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-9292d925-e1a1-48eb-a08b-73093f35e36d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1507 microversion: 2.1 time: 0.766653 Feb 03 02:58:52.333151 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 197/426] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:51 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1507 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:58:52.471616 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-409dc9dd-ba8c-42a2-8947-c41ac81ee883 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:52.487087 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-409dc9dd-ba8c-42a2-8947-c41ac81ee883 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1725 microversion: 2.1 time: 0.732775 Feb 03 02:58:52.500507 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 230/427] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:51 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1725 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:52.552623 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-dd1b91d5-b5ce-426f-a86b-1214df8d2c92 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:52.553261 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-dd1b91d5-b5ce-426f-a86b-1214df8d2c92 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: d861e845-ecc7-4b5a-85a6-71a9af607f86] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:52.562423 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-dd1b91d5-b5ce-426f-a86b-1214df8d2c92 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:52.563544 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-dd1b91d5-b5ce-426f-a86b-1214df8d2c92 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:52.564979 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-dd1b91d5-b5ce-426f-a86b-1214df8d2c92 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:52.565931 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-dd1b91d5-b5ce-426f-a86b-1214df8d2c92 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:52.718098 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-dd1b91d5-b5ce-426f-a86b-1214df8d2c92 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:52.728037 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-dd1b91d5-b5ce-426f-a86b-1214df8d2c92 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86" status: 200 len: 1318 microversion: 2.1 time: 0.179029 Feb 03 02:58:52.728812 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 198/428] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:52 2022] GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:53.354114 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-f9446046-5783-4c6e-9f77-b12262417ac6 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:53.355061 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-f9446046-5783-4c6e-9f77-b12262417ac6 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:53.365657 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f9446046-5783-4c6e-9f77-b12262417ac6 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:53.366389 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f9446046-5783-4c6e-9f77-b12262417ac6 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:53.368326 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f9446046-5783-4c6e-9f77-b12262417ac6 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:53.369635 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f9446046-5783-4c6e-9f77-b12262417ac6 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:53.507349 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-fcf6df81-0c76-4bc1-92a0-3efc15530476 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:53.507990 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-fcf6df81-0c76-4bc1-92a0-3efc15530476 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:53.514277 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fcf6df81-0c76-4bc1-92a0-3efc15530476 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:53.514718 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fcf6df81-0c76-4bc1-92a0-3efc15530476 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:53.515469 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fcf6df81-0c76-4bc1-92a0-3efc15530476 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:53.515901 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fcf6df81-0c76-4bc1-92a0-3efc15530476 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:53.517313 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-f9446046-5783-4c6e-9f77-b12262417ac6 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:53.525133 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-f9446046-5783-4c6e-9f77-b12262417ac6 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1507 microversion: 2.1 time: 0.177617 Feb 03 02:58:53.525713 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 231/429] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:53 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1507 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:53.656396 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-fcf6df81-0c76-4bc1-92a0-3efc15530476 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:53.665703 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-fcf6df81-0c76-4bc1-92a0-3efc15530476 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1725 microversion: 2.1 time: 0.162024 Feb 03 02:58:53.666272 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 199/430] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:53 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:53.748160 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-f8569800-9bf8-4158-acce-6ee062da879e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:53.749186 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-f8569800-9bf8-4158-acce-6ee062da879e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: d861e845-ecc7-4b5a-85a6-71a9af607f86] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:53.759163 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f8569800-9bf8-4158-acce-6ee062da879e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:53.759897 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f8569800-9bf8-4158-acce-6ee062da879e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:53.761247 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f8569800-9bf8-4158-acce-6ee062da879e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:53.761962 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f8569800-9bf8-4158-acce-6ee062da879e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:53.899301 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-f8569800-9bf8-4158-acce-6ee062da879e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:53.910437 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-f8569800-9bf8-4158-acce-6ee062da879e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86" status: 200 len: 1318 microversion: 2.1 time: 0.168114 Feb 03 02:58:53.910976 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 232/431] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:53 2022] GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:54.136179 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-f3fd9f29-99d2-47ca-903e-8beb367ac012 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1201502604", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2139397802", "security_groups": [{"name": "tempest-secgroup-smoke-1298023373"}], "networks": [{"uuid": "60e4bf0b-1fca-4dbb-bbfb-3754d5775022"}], "block_device_mapping_v2": [{"uuid": "cbd221b3-34d6-4a44-83b7-04e591614868", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:58:54.245122 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.network.neutron [None req-f3fd9f29-99d2-47ca-903e-8beb367ac012 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] validate_networks() for [('60e4bf0b-1fca-4dbb-bbfb-3754d5775022', None, None, None, None, None)] {{(pid=116385) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 03 02:58:54.542746 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-54b0e900-9e41-408f-a3f5-372e4f63d61c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:54.543308 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-54b0e900-9e41-408f-a3f5-372e4f63d61c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:54.549797 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-54b0e900-9e41-408f-a3f5-372e4f63d61c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:54.550323 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-54b0e900-9e41-408f-a3f5-372e4f63d61c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:54.551182 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-54b0e900-9e41-408f-a3f5-372e4f63d61c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:54.551693 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-54b0e900-9e41-408f-a3f5-372e4f63d61c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:54.649465 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-f3fd9f29-99d2-47ca-903e-8beb367ac012 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Flavor limits 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 03 02:58:54.649949 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-f3fd9f29-99d2-47ca-903e-8beb367ac012 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Image limits 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 03 02:58:54.650454 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-f3fd9f29-99d2-47ca-903e-8beb367ac012 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Flavor pref 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 03 02:58:54.651053 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-f3fd9f29-99d2-47ca-903e-8beb367ac012 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Image pref 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 03 02:58:54.651458 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-f3fd9f29-99d2-47ca-903e-8beb367ac012 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 03 02:58:54.662087 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f3fd9f29-99d2-47ca-903e-8beb367ac012 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:54.662744 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f3fd9f29-99d2-47ca-903e-8beb367ac012 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:54.663328 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f3fd9f29-99d2-47ca-903e-8beb367ac012 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:54.663812 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f3fd9f29-99d2-47ca-903e-8beb367ac012 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:54.681699 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-f3fd9f29-99d2-47ca-903e-8beb367ac012 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Getting quotas for project 4cde077871f94db3a608b5b79c01883e. Resources: {'cores', 'ram', 'instances'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 02:58:54.685381 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-f3fd9f29-99d2-47ca-903e-8beb367ac012 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Getting quotas for user 2eb1f6ef4005482f8dba7efb00068639 and project 4cde077871f94db3a608b5b79c01883e. Resources: {'cores', 'ram', 'instances'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 02:58:54.712743 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-54b0e900-9e41-408f-a3f5-372e4f63d61c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:54.720276 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-54b0e900-9e41-408f-a3f5-372e4f63d61c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1507 microversion: 2.1 time: 0.181807 Feb 03 02:58:54.730694 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 233/432] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:54 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1507 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:54.730694 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-75369649-accf-48bc-9580-6e5726f49993 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:54.730694 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-75369649-accf-48bc-9580-6e5726f49993 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:54.732483 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-75369649-accf-48bc-9580-6e5726f49993 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:54.732976 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-75369649-accf-48bc-9580-6e5726f49993 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:54.733760 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-75369649-accf-48bc-9580-6e5726f49993 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:54.734189 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-75369649-accf-48bc-9580-6e5726f49993 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:54.741627 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-f3fd9f29-99d2-47ca-903e-8beb367ac012 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Going to run 1 instances... {{(pid=116385) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 03 02:58:54.743918 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-f3fd9f29-99d2-47ca-903e-8beb367ac012 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cbd221b3-34d6-4a44-83b7-04e591614868',volume_size=None,volume_type=None)] {{(pid=116385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 03 02:58:54.872831 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-f3fd9f29-99d2-47ca-903e-8beb367ac012 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.740346 Feb 03 02:58:54.873863 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 200/433] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Feb 3 02:58:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 03 02:58:54.879423 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-75369649-accf-48bc-9580-6e5726f49993 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:54.884486 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-0c8fe2dd-2cae-4bae-86c8-96866861d22d tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:54.885128 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-0c8fe2dd-2cae-4bae-86c8-96866861d22d tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:54.889321 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-75369649-accf-48bc-9580-6e5726f49993 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1725 microversion: 2.1 time: 0.166981 Feb 03 02:58:54.890153 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 234/434] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:54 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:54.927275 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-d3151930-206f-4adc-b69e-49e0497dbd13 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:54.928045 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-d3151930-206f-4adc-b69e-49e0497dbd13 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: d861e845-ecc7-4b5a-85a6-71a9af607f86] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:54.934106 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d3151930-206f-4adc-b69e-49e0497dbd13 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:54.934648 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d3151930-206f-4adc-b69e-49e0497dbd13 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:54.935556 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d3151930-206f-4adc-b69e-49e0497dbd13 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:54.936086 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d3151930-206f-4adc-b69e-49e0497dbd13 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:54.941425 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-0c8fe2dd-2cae-4bae-86c8-96866861d22d tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:54.948514 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-0c8fe2dd-2cae-4bae-86c8-96866861d22d tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1089 microversion: 2.1 time: 0.068395 Feb 03 02:58:54.949330 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 201/435] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:54 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1089 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:55.078704 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-d3151930-206f-4adc-b69e-49e0497dbd13 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:55.087386 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-d3151930-206f-4adc-b69e-49e0497dbd13 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86" status: 200 len: 1318 microversion: 2.1 time: 0.163667 Feb 03 02:58:55.088309 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 235/436] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:54 2022] GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:58:55.738215 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-f416d897-9ae3-413a-bc08-d9ce2a974c21 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:55.738842 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-f416d897-9ae3-413a-bc08-d9ce2a974c21 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:55.745920 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f416d897-9ae3-413a-bc08-d9ce2a974c21 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:55.746585 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f416d897-9ae3-413a-bc08-d9ce2a974c21 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:55.747344 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f416d897-9ae3-413a-bc08-d9ce2a974c21 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:55.747906 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f416d897-9ae3-413a-bc08-d9ce2a974c21 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:55.905879 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-d15c1882-91cc-411c-9c4e-c75aa71628e7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:55.907279 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-d15c1882-91cc-411c-9c4e-c75aa71628e7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:55.914966 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d15c1882-91cc-411c-9c4e-c75aa71628e7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:55.915667 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d15c1882-91cc-411c-9c4e-c75aa71628e7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:55.916659 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d15c1882-91cc-411c-9c4e-c75aa71628e7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:55.917317 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d15c1882-91cc-411c-9c4e-c75aa71628e7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:55.919093 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-f416d897-9ae3-413a-bc08-d9ce2a974c21 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:55.928656 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-f416d897-9ae3-413a-bc08-d9ce2a974c21 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1513 microversion: 2.1 time: 0.194379 Feb 03 02:58:55.929601 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 202/437] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:55 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1513 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:55.965513 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-3044d621-5fc8-44c3-905f-fc4a2e7a2d8a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:55.966711 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-3044d621-5fc8-44c3-905f-fc4a2e7a2d8a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:55.973585 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3044d621-5fc8-44c3-905f-fc4a2e7a2d8a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:55.974781 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3044d621-5fc8-44c3-905f-fc4a2e7a2d8a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:55.975766 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3044d621-5fc8-44c3-905f-fc4a2e7a2d8a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:55.976693 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3044d621-5fc8-44c3-905f-fc4a2e7a2d8a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:56.090369 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-3044d621-5fc8-44c3-905f-fc4a2e7a2d8a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:56.100087 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-3044d621-5fc8-44c3-905f-fc4a2e7a2d8a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1195 microversion: 2.1 time: 0.138286 Feb 03 02:58:56.101624 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 203/438] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:55 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1195 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:56.122471 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-c2e9fd2d-2645-4192-b741-32d3072c15c1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:56.123356 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-c2e9fd2d-2645-4192-b741-32d3072c15c1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: d861e845-ecc7-4b5a-85a6-71a9af607f86] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:56.132919 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c2e9fd2d-2645-4192-b741-32d3072c15c1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:56.133943 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c2e9fd2d-2645-4192-b741-32d3072c15c1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:56.135077 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c2e9fd2d-2645-4192-b741-32d3072c15c1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:56.139794 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c2e9fd2d-2645-4192-b741-32d3072c15c1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:56.241879 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-d15c1882-91cc-411c-9c4e-c75aa71628e7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:56.253282 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-d15c1882-91cc-411c-9c4e-c75aa71628e7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1725 microversion: 2.1 time: 0.351133 Feb 03 02:58:56.267713 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 236/439] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:55 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1725 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:58:56.403590 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-c2e9fd2d-2645-4192-b741-32d3072c15c1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:56.411558 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-c2e9fd2d-2645-4192-b741-32d3072c15c1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86" status: 200 len: 1318 microversion: 2.1 time: 0.307754 Feb 03 02:58:56.412496 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 204/440] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:56 2022] GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:57.118063 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-81d9eae3-5044-4006-9e91-839ba9042cc3 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:57.118659 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-81d9eae3-5044-4006-9e91-839ba9042cc3 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:57.125172 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-81d9eae3-5044-4006-9e91-839ba9042cc3 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:57.125535 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-81d9eae3-5044-4006-9e91-839ba9042cc3 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:57.126528 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-81d9eae3-5044-4006-9e91-839ba9042cc3 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:57.127150 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-81d9eae3-5044-4006-9e91-839ba9042cc3 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:57.275127 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-3dfa6a61-90ca-4f1a-9a30-028dd972893f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:57.276968 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-3dfa6a61-90ca-4f1a-9a30-028dd972893f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:57.281786 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-81d9eae3-5044-4006-9e91-839ba9042cc3 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:57.286003 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3dfa6a61-90ca-4f1a-9a30-028dd972893f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:57.286335 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3dfa6a61-90ca-4f1a-9a30-028dd972893f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:57.287112 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3dfa6a61-90ca-4f1a-9a30-028dd972893f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:57.287535 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3dfa6a61-90ca-4f1a-9a30-028dd972893f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:57.292060 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-81d9eae3-5044-4006-9e91-839ba9042cc3 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1261 microversion: 2.1 time: 0.177536 Feb 03 02:58:57.292891 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 237/441] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:57 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1261 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:57.410006 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-8b609388-2665-43c2-ab9b-65ce2dec6663 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:57.410870 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-8b609388-2665-43c2-ab9b-65ce2dec6663 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:57.419105 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8b609388-2665-43c2-ab9b-65ce2dec6663 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:57.421652 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8b609388-2665-43c2-ab9b-65ce2dec6663 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:57.424515 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8b609388-2665-43c2-ab9b-65ce2dec6663 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:57.425063 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8b609388-2665-43c2-ab9b-65ce2dec6663 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:57.474904 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-3dfa6a61-90ca-4f1a-9a30-028dd972893f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:57.485408 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-3dfa6a61-90ca-4f1a-9a30-028dd972893f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1702 microversion: 2.1 time: 0.214926 Feb 03 02:58:57.486312 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 205/442] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:57 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1702 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:58:57.493693 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-c01f64c7-f31d-447e-8554-3d2f35a58bd5 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:57.495592 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-c01f64c7-f31d-447e-8554-3d2f35a58bd5 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: d861e845-ecc7-4b5a-85a6-71a9af607f86] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:57.508182 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c01f64c7-f31d-447e-8554-3d2f35a58bd5 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:57.508863 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c01f64c7-f31d-447e-8554-3d2f35a58bd5 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:57.510042 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c01f64c7-f31d-447e-8554-3d2f35a58bd5 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:57.513638 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c01f64c7-f31d-447e-8554-3d2f35a58bd5 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:57.714302 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-8b609388-2665-43c2-ab9b-65ce2dec6663 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:57.730800 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-8b609388-2665-43c2-ab9b-65ce2dec6663 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1513 microversion: 2.1 time: 0.324608 Feb 03 02:58:57.731642 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 238/443] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:57 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1513 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:58:57.744490 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-16cd0c1e-7482-451c-9421-839830ef9f1b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:58:57.759161 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-16cd0c1e-7482-451c-9421-839830ef9f1b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:57.761165 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-16cd0c1e-7482-451c-9421-839830ef9f1b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:57.773055 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-c01f64c7-f31d-447e-8554-3d2f35a58bd5 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:57.807536 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-c01f64c7-f31d-447e-8554-3d2f35a58bd5 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86" status: 200 len: 1318 microversion: 2.1 time: 0.319926 Feb 03 02:58:57.808238 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 206/444] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:57 2022] GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86 => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:57.817272 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-03804888-51c9-4f8e-8a18-c054b6e3dc26 req-f035e93d-afa9-40f9-9c35-45ca907b2dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76a23dfa-b676-4e5a-b50a-126b1edd49e5", "tag": "e9d2989c-2c82-4969-8caa-45dce6105669"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:58:57.823079 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:58:57.823079 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 02:58:57.831907 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-16cd0c1e-7482-451c-9421-839830ef9f1b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Going to try to start instance {{(pid=116386) start /opt/stack/nova/nova/compute/api.py:2677}} Feb 03 02:58:57.832756 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-03804888-51c9-4f8e-8a18-c054b6e3dc26 req-f035e93d-afa9-40f9-9c35-45ca907b2dc7 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:57.833347 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-03804888-51c9-4f8e-8a18-c054b6e3dc26 req-f035e93d-afa9-40f9-9c35-45ca907b2dc7 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:57.861275 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-03804888-51c9-4f8e-8a18-c054b6e3dc26 req-f035e93d-afa9-40f9-9c35-45ca907b2dc7 service nova] Creating event network-changed:e9d2989c-2c82-4969-8caa-45dce6105669 for instance 76a23dfa-b676-4e5a-b50a-126b1edd49e5 on hv-cinder-82758 Feb 03 02:58:57.869346 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-03804888-51c9-4f8e-8a18-c054b6e3dc26 req-f035e93d-afa9-40f9-9c35-45ca907b2dc7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059393 Feb 03 02:58:57.870620 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 207/445] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:58:57.878795 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-e7e1581f-c4c0-4a6d-b671-c58857035eba tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe687108-a88a-428f-bdc6-a4535c9eaf39"}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:58:57.881854 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-e7e1581f-c4c0-4a6d-b671-c58857035eba tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:57.891658 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e7e1581f-c4c0-4a6d-b671-c58857035eba tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:57.892455 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e7e1581f-c4c0-4a6d-b671-c58857035eba tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:57.893516 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e7e1581f-c4c0-4a6d-b671-c58857035eba tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:57.894248 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e7e1581f-c4c0-4a6d-b671-c58857035eba tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:57.904085 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-16cd0c1e-7482-451c-9421-839830ef9f1b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "POST /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c/action" status: 202 len: 0 microversion: 2.1 time: 0.162934 Feb 03 02:58:57.907901 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 239/446] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Feb 3 02:58:57 2022] POST /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 03 02:58:57.923797 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-ed9e55e5-7ea4-4946-9a9c-a7e729f067b3 req-9d633ace-841b-4f89-8f69-0721169e5e63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d861e845-ecc7-4b5a-85a6-71a9af607f86", "name": "network-vif-plugged", "status": "completed", "tag": "716697ab-7116-4750-bb15-40d6691bc75e"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:58:57.930021 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:58:57.930021 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 02:58:57.944074 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-ed9e55e5-7ea4-4946-9a9c-a7e729f067b3 req-9d633ace-841b-4f89-8f69-0721169e5e63 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:57.946045 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-ed9e55e5-7ea4-4946-9a9c-a7e729f067b3 req-9d633ace-841b-4f89-8f69-0721169e5e63 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:57.973052 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-ed9e55e5-7ea4-4946-9a9c-a7e729f067b3 req-9d633ace-841b-4f89-8f69-0721169e5e63 service nova] Creating event network-vif-plugged:716697ab-7116-4750-bb15-40d6691bc75e for instance d861e845-ecc7-4b5a-85a6-71a9af607f86 on hv-cinder-82758 Feb 03 02:58:57.989903 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-ed9e55e5-7ea4-4946-9a9c-a7e729f067b3 req-9d633ace-841b-4f89-8f69-0721169e5e63 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080221 Feb 03 02:58:57.990944 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 240/447] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:58:57.995983 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-056f24a4-66e7-4c38-8221-e8a74cd27e2a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:57.996849 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-056f24a4-66e7-4c38-8221-e8a74cd27e2a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:58.007874 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-056f24a4-66e7-4c38-8221-e8a74cd27e2a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:58.010958 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-056f24a4-66e7-4c38-8221-e8a74cd27e2a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:58.013767 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-056f24a4-66e7-4c38-8221-e8a74cd27e2a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:58.014462 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-056f24a4-66e7-4c38-8221-e8a74cd27e2a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:58.329034 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-056f24a4-66e7-4c38-8221-e8a74cd27e2a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:58.331067 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-e7e1581f-c4c0-4a6d-b671-c58857035eba tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "POST /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.458584 Feb 03 02:58:58.334456 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 208/448] 10.222.0.31 () {60 vars in 1322 bytes} [Thu Feb 3 02:58:57 2022] POST /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e/os-volume_attachments => generated 194 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:58:58.338125 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-056f24a4-66e7-4c38-8221-e8a74cd27e2a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1711 microversion: 2.1 time: 0.345843 Feb 03 02:58:58.342677 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-61972cf9-26fc-4978-8268-c48a0f917211 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:58.343095 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 241/449] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:57 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1711 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:58.344803 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-61972cf9-26fc-4978-8268-c48a0f917211 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:58.358464 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-61972cf9-26fc-4978-8268-c48a0f917211 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:58.360607 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-61972cf9-26fc-4978-8268-c48a0f917211 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:58.362407 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-61972cf9-26fc-4978-8268-c48a0f917211 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:58.363556 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-61972cf9-26fc-4978-8268-c48a0f917211 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:58.630524 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-61972cf9-26fc-4978-8268-c48a0f917211 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:58.640985 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-61972cf9-26fc-4978-8268-c48a0f917211 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1261 microversion: 2.1 time: 0.304979 Feb 03 02:58:58.641832 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 209/450] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:58 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1261 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:58.825093 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-242d4908-8a19-4c7c-8331-3288f032167f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:58.825741 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-242d4908-8a19-4c7c-8331-3288f032167f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: d861e845-ecc7-4b5a-85a6-71a9af607f86] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:58.832288 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-242d4908-8a19-4c7c-8331-3288f032167f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:58.832857 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-242d4908-8a19-4c7c-8331-3288f032167f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:58.833746 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-242d4908-8a19-4c7c-8331-3288f032167f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:58.834396 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-242d4908-8a19-4c7c-8331-3288f032167f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:59.043526 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-242d4908-8a19-4c7c-8331-3288f032167f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:59.051800 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-242d4908-8a19-4c7c-8331-3288f032167f tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86" status: 200 len: 1318 microversion: 2.1 time: 0.230453 Feb 03 02:58:59.052382 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 242/451] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:58 2022] GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:58:59.368501 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-36115e5f-848b-4898-a81e-635c52af60c3 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:59.369528 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-36115e5f-848b-4898-a81e-635c52af60c3 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:59.378792 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-36115e5f-848b-4898-a81e-635c52af60c3 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:59.379230 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-36115e5f-848b-4898-a81e-635c52af60c3 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:59.380282 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-36115e5f-848b-4898-a81e-635c52af60c3 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:59.380428 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-36115e5f-848b-4898-a81e-635c52af60c3 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:59.520748 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-36115e5f-848b-4898-a81e-635c52af60c3 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:59.529120 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-36115e5f-848b-4898-a81e-635c52af60c3 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1711 microversion: 2.1 time: 0.166731 Feb 03 02:58:59.529802 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 210/452] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:59 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1711 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:58:59.658609 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-3c3b17e2-0a4a-4979-9a5e-1826feab1f9f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:58:59.659223 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-3c3b17e2-0a4a-4979-9a5e-1826feab1f9f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:58:59.665693 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3c3b17e2-0a4a-4979-9a5e-1826feab1f9f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:59.666137 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3c3b17e2-0a4a-4979-9a5e-1826feab1f9f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:59.666902 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3c3b17e2-0a4a-4979-9a5e-1826feab1f9f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:58:59.667328 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3c3b17e2-0a4a-4979-9a5e-1826feab1f9f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:58:59.807081 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-3c3b17e2-0a4a-4979-9a5e-1826feab1f9f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:58:59.814615 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-3c3b17e2-0a4a-4979-9a5e-1826feab1f9f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1261 microversion: 2.1 time: 0.160007 Feb 03 02:58:59.815167 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 243/453] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:58:59 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:00.069327 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-95e87134-871b-4e80-a218-61de3efd0c59 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:00.070330 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-95e87134-871b-4e80-a218-61de3efd0c59 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: d861e845-ecc7-4b5a-85a6-71a9af607f86] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:00.076958 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-95e87134-871b-4e80-a218-61de3efd0c59 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:00.077402 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-95e87134-871b-4e80-a218-61de3efd0c59 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:00.078163 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-95e87134-871b-4e80-a218-61de3efd0c59 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:00.078591 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-95e87134-871b-4e80-a218-61de3efd0c59 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:00.228287 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-95e87134-871b-4e80-a218-61de3efd0c59 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:00.235657 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-95e87134-871b-4e80-a218-61de3efd0c59 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86" status: 200 len: 1318 microversion: 2.1 time: 0.169994 Feb 03 02:59:00.236224 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 211/454] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:00 2022] GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:00.546305 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-c721f599-8612-4a4e-a6b3-4cb92362927c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:00.546920 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-c721f599-8612-4a4e-a6b3-4cb92362927c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:00.553172 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c721f599-8612-4a4e-a6b3-4cb92362927c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:00.553623 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c721f599-8612-4a4e-a6b3-4cb92362927c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:00.554410 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c721f599-8612-4a4e-a6b3-4cb92362927c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:00.554847 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c721f599-8612-4a4e-a6b3-4cb92362927c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:00.700986 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-c721f599-8612-4a4e-a6b3-4cb92362927c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:00.713082 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-c721f599-8612-4a4e-a6b3-4cb92362927c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1715 microversion: 2.1 time: 0.170217 Feb 03 02:59:00.713891 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 244/455] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:00 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1715 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:00.832263 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-16ba500e-8b13-4244-80d7-935dec3a32fe tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:00.832846 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-16ba500e-8b13-4244-80d7-935dec3a32fe tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:00.839528 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-16ba500e-8b13-4244-80d7-935dec3a32fe tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:00.839961 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-16ba500e-8b13-4244-80d7-935dec3a32fe tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:00.840751 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-16ba500e-8b13-4244-80d7-935dec3a32fe tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:00.841183 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-16ba500e-8b13-4244-80d7-935dec3a32fe tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:00.979792 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-16ba500e-8b13-4244-80d7-935dec3a32fe tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:00.987682 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-16ba500e-8b13-4244-80d7-935dec3a32fe tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1261 microversion: 2.1 time: 0.159222 Feb 03 02:59:00.988217 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 212/456] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:00 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:01.251903 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-576d1212-86ad-466c-af17-4a28c4e73ada tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:01.252508 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-576d1212-86ad-466c-af17-4a28c4e73ada tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: d861e845-ecc7-4b5a-85a6-71a9af607f86] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:01.258853 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-576d1212-86ad-466c-af17-4a28c4e73ada tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:01.259303 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-576d1212-86ad-466c-af17-4a28c4e73ada tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:01.260076 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-576d1212-86ad-466c-af17-4a28c4e73ada tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:01.260508 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-576d1212-86ad-466c-af17-4a28c4e73ada tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:01.395758 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-576d1212-86ad-466c-af17-4a28c4e73ada tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:01.405442 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-576d1212-86ad-466c-af17-4a28c4e73ada tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86" status: 200 len: 1508 microversion: 2.1 time: 0.157171 Feb 03 02:59:01.406275 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 245/457] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:01 2022] GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:02.004238 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-78cc628a-208b-4687-8bf0-f6d3d625cd88 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:02.005167 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-78cc628a-208b-4687-8bf0-f6d3d625cd88 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:02.012338 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-78cc628a-208b-4687-8bf0-f6d3d625cd88 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:02.012871 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-78cc628a-208b-4687-8bf0-f6d3d625cd88 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:02.013799 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-78cc628a-208b-4687-8bf0-f6d3d625cd88 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:02.014276 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-78cc628a-208b-4687-8bf0-f6d3d625cd88 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:02.154167 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-78cc628a-208b-4687-8bf0-f6d3d625cd88 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:02.162335 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-78cc628a-208b-4687-8bf0-f6d3d625cd88 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1261 microversion: 2.1 time: 0.162376 Feb 03 02:59:02.162903 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 213/458] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:01 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:02.720902 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-416d226d-0c88-4ad1-95f9-95fe7c1b9cfe tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f65fe787-b40a-43a8-9014-59cfc599dc4c"}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:59:02.722036 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-416d226d-0c88-4ad1-95f9-95fe7c1b9cfe tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: d861e845-ecc7-4b5a-85a6-71a9af607f86] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:02.728989 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-416d226d-0c88-4ad1-95f9-95fe7c1b9cfe tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:02.729430 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-416d226d-0c88-4ad1-95f9-95fe7c1b9cfe tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:02.730201 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-416d226d-0c88-4ad1-95f9-95fe7c1b9cfe tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:02.730630 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-416d226d-0c88-4ad1-95f9-95fe7c1b9cfe tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:02.979478 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-416d226d-0c88-4ad1-95f9-95fe7c1b9cfe tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "POST /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262294 Feb 03 02:59:02.980462 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 246/459] 10.222.0.31 () {60 vars in 1322 bytes} [Thu Feb 3 02:59:02 2022] POST /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:59:03.182365 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-cc7d13d5-9ea9-4a5b-9581-1e61d5337c3e tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:03.183364 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-cc7d13d5-9ea9-4a5b-9581-1e61d5337c3e tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:03.193061 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-cc7d13d5-9ea9-4a5b-9581-1e61d5337c3e tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:03.193506 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-cc7d13d5-9ea9-4a5b-9581-1e61d5337c3e tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:03.194283 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-cc7d13d5-9ea9-4a5b-9581-1e61d5337c3e tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:03.194720 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-cc7d13d5-9ea9-4a5b-9581-1e61d5337c3e tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:03.336889 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-cc7d13d5-9ea9-4a5b-9581-1e61d5337c3e tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:03.345035 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-cc7d13d5-9ea9-4a5b-9581-1e61d5337c3e tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1261 microversion: 2.1 time: 0.168776 Feb 03 02:59:03.345606 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 214/460] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:03 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:04.367608 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-768b886c-6df5-48f4-8b01-c595fd0727f7 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:04.368679 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-768b886c-6df5-48f4-8b01-c595fd0727f7 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:04.379760 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-768b886c-6df5-48f4-8b01-c595fd0727f7 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:04.380213 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-768b886c-6df5-48f4-8b01-c595fd0727f7 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:04.381044 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-768b886c-6df5-48f4-8b01-c595fd0727f7 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:04.381483 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-768b886c-6df5-48f4-8b01-c595fd0727f7 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:04.522931 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-768b886c-6df5-48f4-8b01-c595fd0727f7 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:04.530988 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-768b886c-6df5-48f4-8b01-c595fd0727f7 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1261 microversion: 2.1 time: 0.170440 Feb 03 02:59:04.531556 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 247/461] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:04 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:05.547813 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-30b9f67a-db5e-431c-9121-b35b24ff1a77 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:05.548389 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-30b9f67a-db5e-431c-9121-b35b24ff1a77 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:05.555958 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-30b9f67a-db5e-431c-9121-b35b24ff1a77 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:05.556397 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-30b9f67a-db5e-431c-9121-b35b24ff1a77 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:05.557214 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-30b9f67a-db5e-431c-9121-b35b24ff1a77 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:05.557633 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-30b9f67a-db5e-431c-9121-b35b24ff1a77 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:05.697237 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-30b9f67a-db5e-431c-9121-b35b24ff1a77 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:05.705512 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-30b9f67a-db5e-431c-9121-b35b24ff1a77 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1261 microversion: 2.1 time: 0.161398 Feb 03 02:59:05.706110 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 215/462] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:05 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:06.725767 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-6fd70ecf-d68c-44a6-8b32-7105a8670c8c tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:06.726433 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-6fd70ecf-d68c-44a6-8b32-7105a8670c8c tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:06.736375 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6fd70ecf-d68c-44a6-8b32-7105a8670c8c tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:06.737009 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6fd70ecf-d68c-44a6-8b32-7105a8670c8c tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:06.738228 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6fd70ecf-d68c-44a6-8b32-7105a8670c8c tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:06.738833 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6fd70ecf-d68c-44a6-8b32-7105a8670c8c tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:06.883610 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-6fd70ecf-d68c-44a6-8b32-7105a8670c8c tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:06.890972 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-6fd70ecf-d68c-44a6-8b32-7105a8670c8c tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1261 microversion: 2.1 time: 0.171507 Feb 03 02:59:06.891507 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 248/463] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:06 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:06.921775 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-a255331b-dd42-4694-95ce-3717072e1d60 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:59:06.922791 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-a255331b-dd42-4694-95ce-3717072e1d60 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:06.929602 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a255331b-dd42-4694-95ce-3717072e1d60 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:06.930056 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a255331b-dd42-4694-95ce-3717072e1d60 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:06.930839 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a255331b-dd42-4694-95ce-3717072e1d60 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:06.931314 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a255331b-dd42-4694-95ce-3717072e1d60 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:06.959135 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.objects.instance [None req-a255331b-dd42-4694-95ce-3717072e1d60 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lazy-loading 'flavor' on Instance uuid 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e {{(pid=116385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 03 02:59:07.118151 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-a255331b-dd42-4694-95ce-3717072e1d60 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "POST /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e/action" status: 200 len: 32 microversion: 2.1 time: 0.200137 Feb 03 02:59:07.118751 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 216/464] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Feb 3 02:59:06 2022] POST /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e/action => generated 32 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 03 02:59:07.127488 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-560aa61b-21d0-4295-8ca8-112b35ed37dc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:07.128082 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-560aa61b-21d0-4295-8ca8-112b35ed37dc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:07.134041 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-560aa61b-21d0-4295-8ca8-112b35ed37dc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:07.134479 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-560aa61b-21d0-4295-8ca8-112b35ed37dc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:07.135240 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-560aa61b-21d0-4295-8ca8-112b35ed37dc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:07.135665 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-560aa61b-21d0-4295-8ca8-112b35ed37dc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:07.270936 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-560aa61b-21d0-4295-8ca8-112b35ed37dc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:07.278899 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-560aa61b-21d0-4295-8ca8-112b35ed37dc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.154989 Feb 03 02:59:07.279453 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 249/465] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:07 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:07.912070 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-2231acb1-1b7c-4280-9ce1-fd07df891c4d tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:07.913239 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-2231acb1-1b7c-4280-9ce1-fd07df891c4d tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:07.924873 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2231acb1-1b7c-4280-9ce1-fd07df891c4d tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:07.925829 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2231acb1-1b7c-4280-9ce1-fd07df891c4d tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:07.926838 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2231acb1-1b7c-4280-9ce1-fd07df891c4d tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:07.927664 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2231acb1-1b7c-4280-9ce1-fd07df891c4d tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:08.085360 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-2231acb1-1b7c-4280-9ce1-fd07df891c4d tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:08.093367 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-2231acb1-1b7c-4280-9ce1-fd07df891c4d tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1261 microversion: 2.1 time: 0.188086 Feb 03 02:59:08.094015 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 217/466] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:07 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1261 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:08.297528 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-bbf94a5f-184e-46b3-91a9-e717ebceedc6 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:08.298129 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-bbf94a5f-184e-46b3-91a9-e717ebceedc6 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:08.323252 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-bbf94a5f-184e-46b3-91a9-e717ebceedc6 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:08.324229 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-bbf94a5f-184e-46b3-91a9-e717ebceedc6 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:08.325961 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-bbf94a5f-184e-46b3-91a9-e717ebceedc6 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:08.326621 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-bbf94a5f-184e-46b3-91a9-e717ebceedc6 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:08.474731 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-bbf94a5f-184e-46b3-91a9-e717ebceedc6 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:08.483777 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-bbf94a5f-184e-46b3-91a9-e717ebceedc6 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.191076 Feb 03 02:59:08.484627 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 250/467] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:08 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:09.110774 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-4b634090-f142-4d9c-9bd2-e5ee2ddd778a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:09.111991 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-4b634090-f142-4d9c-9bd2-e5ee2ddd778a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:09.119733 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4b634090-f142-4d9c-9bd2-e5ee2ddd778a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:09.120195 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4b634090-f142-4d9c-9bd2-e5ee2ddd778a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:09.121290 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4b634090-f142-4d9c-9bd2-e5ee2ddd778a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:09.121696 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4b634090-f142-4d9c-9bd2-e5ee2ddd778a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:09.260405 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-4b634090-f142-4d9c-9bd2-e5ee2ddd778a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:09.268558 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-4b634090-f142-4d9c-9bd2-e5ee2ddd778a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1261 microversion: 2.1 time: 0.161653 Feb 03 02:59:09.269146 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 218/468] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:09 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:09.503971 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-8f9fa69c-13a8-4b9e-b416-535a99597dd4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:09.504936 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-8f9fa69c-13a8-4b9e-b416-535a99597dd4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:09.515449 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8f9fa69c-13a8-4b9e-b416-535a99597dd4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:09.516121 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8f9fa69c-13a8-4b9e-b416-535a99597dd4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:09.517372 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8f9fa69c-13a8-4b9e-b416-535a99597dd4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:09.518043 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8f9fa69c-13a8-4b9e-b416-535a99597dd4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:09.657986 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-8f9fa69c-13a8-4b9e-b416-535a99597dd4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:09.666659 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-8f9fa69c-13a8-4b9e-b416-535a99597dd4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.168374 Feb 03 02:59:09.667231 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 251/469] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:09 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:10.285394 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-a1d81662-8cc6-4afc-8ceb-3ab5a475e8d3 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:10.285987 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-a1d81662-8cc6-4afc-8ceb-3ab5a475e8d3 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:10.292505 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a1d81662-8cc6-4afc-8ceb-3ab5a475e8d3 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:10.292981 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a1d81662-8cc6-4afc-8ceb-3ab5a475e8d3 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:10.293738 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a1d81662-8cc6-4afc-8ceb-3ab5a475e8d3 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:10.294161 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a1d81662-8cc6-4afc-8ceb-3ab5a475e8d3 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:10.435819 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-a1d81662-8cc6-4afc-8ceb-3ab5a475e8d3 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:10.443329 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-a1d81662-8cc6-4afc-8ceb-3ab5a475e8d3 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1261 microversion: 2.1 time: 0.161540 Feb 03 02:59:10.443968 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 219/470] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:10 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:10.683765 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-6577daac-608c-4d80-a237-3c5d085963cb tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:10.684474 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-6577daac-608c-4d80-a237-3c5d085963cb tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:10.690978 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6577daac-608c-4d80-a237-3c5d085963cb tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:10.691427 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6577daac-608c-4d80-a237-3c5d085963cb tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:10.692210 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6577daac-608c-4d80-a237-3c5d085963cb tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:10.692645 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6577daac-608c-4d80-a237-3c5d085963cb tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:10.841117 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-6577daac-608c-4d80-a237-3c5d085963cb tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:10.849254 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-6577daac-608c-4d80-a237-3c5d085963cb tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.169321 Feb 03 02:59:10.849824 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 252/471] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:10 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:11.462049 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-f3efb7a6-f2fe-4439-a3dd-860aee076c23 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:11.462642 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-f3efb7a6-f2fe-4439-a3dd-860aee076c23 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:11.469408 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f3efb7a6-f2fe-4439-a3dd-860aee076c23 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:11.469969 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f3efb7a6-f2fe-4439-a3dd-860aee076c23 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:11.470970 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f3efb7a6-f2fe-4439-a3dd-860aee076c23 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:11.471605 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f3efb7a6-f2fe-4439-a3dd-860aee076c23 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:11.616103 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-f3efb7a6-f2fe-4439-a3dd-860aee076c23 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:11.625148 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-f3efb7a6-f2fe-4439-a3dd-860aee076c23 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1261 microversion: 2.1 time: 0.168286 Feb 03 02:59:11.625723 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 220/472] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:11 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:11.792846 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-eccdda5e-541a-4783-8bb0-3176a07054f2 req-833f92c8-5d18-4bfa-be1e-1095740dc867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a23dfa-b676-4e5a-b50a-126b1edd49e5", "name": "network-vif-plugged", "status": "completed", "tag": "e9d2989c-2c82-4969-8caa-45dce6105669"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:59:11.794554 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:59:11.794554 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 02:59:11.802397 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-eccdda5e-541a-4783-8bb0-3176a07054f2 req-833f92c8-5d18-4bfa-be1e-1095740dc867 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:11.802921 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-eccdda5e-541a-4783-8bb0-3176a07054f2 req-833f92c8-5d18-4bfa-be1e-1095740dc867 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:11.816360 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-eccdda5e-541a-4783-8bb0-3176a07054f2 req-833f92c8-5d18-4bfa-be1e-1095740dc867 service nova] Creating event network-vif-plugged:e9d2989c-2c82-4969-8caa-45dce6105669 for instance 76a23dfa-b676-4e5a-b50a-126b1edd49e5 on hv-cinder-82758 Feb 03 02:59:11.823898 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-eccdda5e-541a-4783-8bb0-3176a07054f2 req-833f92c8-5d18-4bfa-be1e-1095740dc867 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032392 Feb 03 02:59:11.823898 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 253/473] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 03 02:59:11.869276 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-92a43209-88a2-4194-9f11-aab7561316d2 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:11.871474 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-92a43209-88a2-4194-9f11-aab7561316d2 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:11.877684 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-92a43209-88a2-4194-9f11-aab7561316d2 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:11.878127 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-92a43209-88a2-4194-9f11-aab7561316d2 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:11.878931 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-92a43209-88a2-4194-9f11-aab7561316d2 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:11.879358 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-92a43209-88a2-4194-9f11-aab7561316d2 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:12.025590 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-92a43209-88a2-4194-9f11-aab7561316d2 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:12.033639 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-92a43209-88a2-4194-9f11-aab7561316d2 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.171061 Feb 03 02:59:12.034212 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 221/474] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:11 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:12.644829 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-15978e96-664e-4ced-9c16-72b7d795724f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:12.645700 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-15978e96-664e-4ced-9c16-72b7d795724f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:12.654563 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-15978e96-664e-4ced-9c16-72b7d795724f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:12.655221 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-15978e96-664e-4ced-9c16-72b7d795724f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:12.656410 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-15978e96-664e-4ced-9c16-72b7d795724f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:12.657069 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-15978e96-664e-4ced-9c16-72b7d795724f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:12.799083 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-15978e96-664e-4ced-9c16-72b7d795724f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:12.811340 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-15978e96-664e-4ced-9c16-72b7d795724f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1261 microversion: 2.1 time: 0.172909 Feb 03 02:59:12.812063 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 254/475] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:12 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1261 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:13.051192 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-a44d027f-a78d-4383-9021-36b607091ba0 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:13.051706 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-a44d027f-a78d-4383-9021-36b607091ba0 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:13.058635 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a44d027f-a78d-4383-9021-36b607091ba0 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:13.059078 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a44d027f-a78d-4383-9021-36b607091ba0 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:13.059843 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a44d027f-a78d-4383-9021-36b607091ba0 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:13.060269 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a44d027f-a78d-4383-9021-36b607091ba0 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:13.202076 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-a44d027f-a78d-4383-9021-36b607091ba0 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:13.210722 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-a44d027f-a78d-4383-9021-36b607091ba0 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.163657 Feb 03 02:59:13.211384 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 222/476] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:13 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:13.834958 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-5d43113a-8e89-4e4a-a0b1-5dd7133c08fc tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:13.835862 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-5d43113a-8e89-4e4a-a0b1-5dd7133c08fc tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:13.842838 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5d43113a-8e89-4e4a-a0b1-5dd7133c08fc tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:13.843275 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5d43113a-8e89-4e4a-a0b1-5dd7133c08fc tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:13.844054 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5d43113a-8e89-4e4a-a0b1-5dd7133c08fc tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:13.844481 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5d43113a-8e89-4e4a-a0b1-5dd7133c08fc tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:13.992361 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-5d43113a-8e89-4e4a-a0b1-5dd7133c08fc tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:14.005773 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-5d43113a-8e89-4e4a-a0b1-5dd7133c08fc tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1261 microversion: 2.1 time: 0.177439 Feb 03 02:59:14.006352 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 255/477] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:13 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1261 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:14.229125 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-e523c838-ad5c-4930-b2d1-0dcfee01db2b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:14.229694 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-e523c838-ad5c-4930-b2d1-0dcfee01db2b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:14.236287 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e523c838-ad5c-4930-b2d1-0dcfee01db2b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:14.236826 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e523c838-ad5c-4930-b2d1-0dcfee01db2b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:14.237726 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e523c838-ad5c-4930-b2d1-0dcfee01db2b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:14.238328 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e523c838-ad5c-4930-b2d1-0dcfee01db2b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:14.371397 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-e523c838-ad5c-4930-b2d1-0dcfee01db2b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:14.379881 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-e523c838-ad5c-4930-b2d1-0dcfee01db2b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.154859 Feb 03 02:59:14.380801 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 223/478] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:14 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:15.027979 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-bb49caa3-24fa-40a5-805b-6d5f48a08bfd tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:15.028761 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-bb49caa3-24fa-40a5-805b-6d5f48a08bfd tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:15.036082 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-bb49caa3-24fa-40a5-805b-6d5f48a08bfd tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:15.036526 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-bb49caa3-24fa-40a5-805b-6d5f48a08bfd tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:15.037346 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-bb49caa3-24fa-40a5-805b-6d5f48a08bfd tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:15.037817 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-bb49caa3-24fa-40a5-805b-6d5f48a08bfd tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:15.176046 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-bb49caa3-24fa-40a5-805b-6d5f48a08bfd tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:15.183557 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-bb49caa3-24fa-40a5-805b-6d5f48a08bfd tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1261 microversion: 2.1 time: 0.159368 Feb 03 02:59:15.184115 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 256/479] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:15 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:15.397366 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-16a79ee3-6330-4bde-8f70-7db4093a3551 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:15.397936 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-16a79ee3-6330-4bde-8f70-7db4093a3551 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:15.405131 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-16a79ee3-6330-4bde-8f70-7db4093a3551 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:15.405574 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-16a79ee3-6330-4bde-8f70-7db4093a3551 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:15.406348 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-16a79ee3-6330-4bde-8f70-7db4093a3551 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:15.406779 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-16a79ee3-6330-4bde-8f70-7db4093a3551 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:15.547747 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-16a79ee3-6330-4bde-8f70-7db4093a3551 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:15.555927 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-16a79ee3-6330-4bde-8f70-7db4093a3551 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.162356 Feb 03 02:59:15.556529 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 224/480] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:15 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:16.200295 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-0c819786-8506-4c24-809e-cfe2f0292540 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:16.200932 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-0c819786-8506-4c24-809e-cfe2f0292540 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:16.207990 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0c819786-8506-4c24-809e-cfe2f0292540 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:16.208440 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0c819786-8506-4c24-809e-cfe2f0292540 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:16.209256 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0c819786-8506-4c24-809e-cfe2f0292540 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:16.209682 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0c819786-8506-4c24-809e-cfe2f0292540 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:16.350419 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-0c819786-8506-4c24-809e-cfe2f0292540 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:16.358538 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-0c819786-8506-4c24-809e-cfe2f0292540 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1446 microversion: 2.1 time: 0.162000 Feb 03 02:59:16.359172 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 257/481] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:16 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1446 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:16.374944 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-3b259269-6061-46bd-9b47-5306ea7692de tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:16.375540 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-3b259269-6061-46bd-9b47-5306ea7692de tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:16.382013 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3b259269-6061-46bd-9b47-5306ea7692de tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:16.382455 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3b259269-6061-46bd-9b47-5306ea7692de tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:16.383211 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3b259269-6061-46bd-9b47-5306ea7692de tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:16.383662 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3b259269-6061-46bd-9b47-5306ea7692de tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:16.543621 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-3b259269-6061-46bd-9b47-5306ea7692de tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:16.551128 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-3b259269-6061-46bd-9b47-5306ea7692de tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1446 microversion: 2.1 time: 0.179853 Feb 03 02:59:16.551723 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 225/482] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:16 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1446 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:16.573336 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-7b35ddaa-09cf-4bdd-b14b-983b114ead54 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:16.573966 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-7b35ddaa-09cf-4bdd-b14b-983b114ead54 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:16.580314 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7b35ddaa-09cf-4bdd-b14b-983b114ead54 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:16.580947 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7b35ddaa-09cf-4bdd-b14b-983b114ead54 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:16.581850 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7b35ddaa-09cf-4bdd-b14b-983b114ead54 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:16.582291 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7b35ddaa-09cf-4bdd-b14b-983b114ead54 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:16.716313 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-7b35ddaa-09cf-4bdd-b14b-983b114ead54 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:16.724882 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-7b35ddaa-09cf-4bdd-b14b-983b114ead54 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.155143 Feb 03 02:59:16.725642 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 258/483] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:16 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:16.932746 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-c75c84e4-5c82-4210-8025-3c4d8909c8d4 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:16.933238 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-c75c84e4-5c82-4210-8025-3c4d8909c8d4 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: d861e845-ecc7-4b5a-85a6-71a9af607f86] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:16.939282 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c75c84e4-5c82-4210-8025-3c4d8909c8d4 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:16.939720 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c75c84e4-5c82-4210-8025-3c4d8909c8d4 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:16.940488 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c75c84e4-5c82-4210-8025-3c4d8909c8d4 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:16.940942 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c75c84e4-5c82-4210-8025-3c4d8909c8d4 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:17.062195 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.objects.instance [None req-c75c84e4-5c82-4210-8025-3c4d8909c8d4 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lazy-loading 'services' on Instance uuid d861e845-ecc7-4b5a-85a6-71a9af607f86 {{(pid=116385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 03 02:59:17.171606 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-c75c84e4-5c82-4210-8025-3c4d8909c8d4 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "DELETE /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86/os-volume_attachments/f65fe787-b40a-43a8-9014-59cfc599dc4c" status: 202 len: 0 microversion: 2.1 time: 0.242467 Feb 03 02:59:17.172264 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 226/484] 10.222.0.31 () {58 vars in 1415 bytes} [Thu Feb 3 02:59:16 2022] DELETE /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86/os-volume_attachments/f65fe787-b40a-43a8-9014-59cfc599dc4c => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 03 02:59:17.180776 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-6f5b10ea-e470-43b0-982f-fe5d73d44180 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:17.182316 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-6f5b10ea-e470-43b0-982f-fe5d73d44180 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: d861e845-ecc7-4b5a-85a6-71a9af607f86] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:17.188113 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6f5b10ea-e470-43b0-982f-fe5d73d44180 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:17.188268 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6f5b10ea-e470-43b0-982f-fe5d73d44180 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:17.189133 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6f5b10ea-e470-43b0-982f-fe5d73d44180 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:17.189603 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6f5b10ea-e470-43b0-982f-fe5d73d44180 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:17.225386 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-6f5b10ea-e470-43b0-982f-fe5d73d44180 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048320 Feb 03 02:59:17.230150 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 259/485] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Feb 3 02:59:17 2022] GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 03 02:59:17.743660 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-d6d60fbf-c676-4815-9e99-e2b9704edf18 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:17.744215 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-d6d60fbf-c676-4815-9e99-e2b9704edf18 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:17.751534 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d6d60fbf-c676-4815-9e99-e2b9704edf18 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:17.751987 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d6d60fbf-c676-4815-9e99-e2b9704edf18 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:17.752760 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d6d60fbf-c676-4815-9e99-e2b9704edf18 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:17.753231 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d6d60fbf-c676-4815-9e99-e2b9704edf18 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:17.962206 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-d6d60fbf-c676-4815-9e99-e2b9704edf18 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:17.971853 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-d6d60fbf-c676-4815-9e99-e2b9704edf18 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.232712 Feb 03 02:59:17.972533 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 227/486] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:17 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:18.237643 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-3c80508e-7a5e-48ce-824f-00c991c045b8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:18.238548 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-3c80508e-7a5e-48ce-824f-00c991c045b8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: d861e845-ecc7-4b5a-85a6-71a9af607f86] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:18.245934 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3c80508e-7a5e-48ce-824f-00c991c045b8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:18.246370 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3c80508e-7a5e-48ce-824f-00c991c045b8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:18.247141 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3c80508e-7a5e-48ce-824f-00c991c045b8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:18.247565 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3c80508e-7a5e-48ce-824f-00c991c045b8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:18.284562 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-3c80508e-7a5e-48ce-824f-00c991c045b8 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050676 Feb 03 02:59:18.285156 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 260/487] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Feb 3 02:59:18 2022] GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:59:18.596827 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-0b6b6881-86b6-4acf-b072-7b83b309c3a6 req-9b6c4732-0881-4c28-a5ff-80a9fc8ead32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76a23dfa-b676-4e5a-b50a-126b1edd49e5", "tag": "e9d2989c-2c82-4969-8caa-45dce6105669"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:59:18.596827 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:59:18.596827 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 02:59:18.602047 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-0b6b6881-86b6-4acf-b072-7b83b309c3a6 req-9b6c4732-0881-4c28-a5ff-80a9fc8ead32 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:18.602601 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-0b6b6881-86b6-4acf-b072-7b83b309c3a6 req-9b6c4732-0881-4c28-a5ff-80a9fc8ead32 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:18.614483 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-0b6b6881-86b6-4acf-b072-7b83b309c3a6 req-9b6c4732-0881-4c28-a5ff-80a9fc8ead32 service nova] Creating event network-changed:e9d2989c-2c82-4969-8caa-45dce6105669 for instance 76a23dfa-b676-4e5a-b50a-126b1edd49e5 on hv-cinder-82758 Feb 03 02:59:18.620011 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-0b6b6881-86b6-4acf-b072-7b83b309c3a6 req-9b6c4732-0881-4c28-a5ff-80a9fc8ead32 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031343 Feb 03 02:59:18.621044 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 228/488] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:59:18.989643 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-56345ae6-da05-4e71-979f-4bd80350b217 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:18.990059 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-56345ae6-da05-4e71-979f-4bd80350b217 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:18.996075 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-56345ae6-da05-4e71-979f-4bd80350b217 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:18.996517 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-56345ae6-da05-4e71-979f-4bd80350b217 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:18.997313 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-56345ae6-da05-4e71-979f-4bd80350b217 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:18.997752 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-56345ae6-da05-4e71-979f-4bd80350b217 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:19.140943 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-56345ae6-da05-4e71-979f-4bd80350b217 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:19.149422 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-56345ae6-da05-4e71-979f-4bd80350b217 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.163823 Feb 03 02:59:19.150000 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 261/489] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:18 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:19.296001 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-e4ef5242-918b-4abb-9257-86afe0a26c6c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:19.297415 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-e4ef5242-918b-4abb-9257-86afe0a26c6c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: d861e845-ecc7-4b5a-85a6-71a9af607f86] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:19.304637 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e4ef5242-918b-4abb-9257-86afe0a26c6c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:19.305112 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e4ef5242-918b-4abb-9257-86afe0a26c6c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:19.305896 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e4ef5242-918b-4abb-9257-86afe0a26c6c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:19.306322 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e4ef5242-918b-4abb-9257-86afe0a26c6c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:19.335891 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-e4ef5242-918b-4abb-9257-86afe0a26c6c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043920 Feb 03 02:59:19.336769 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 229/490] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Feb 3 02:59:19 2022] GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 03 02:59:20.169059 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-73fc8aad-0ad2-4efb-8522-0c4bd39865ef tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:20.169633 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-73fc8aad-0ad2-4efb-8522-0c4bd39865ef tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:20.177216 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-73fc8aad-0ad2-4efb-8522-0c4bd39865ef tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:20.177816 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-73fc8aad-0ad2-4efb-8522-0c4bd39865ef tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:20.178989 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-73fc8aad-0ad2-4efb-8522-0c4bd39865ef tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:20.179590 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-73fc8aad-0ad2-4efb-8522-0c4bd39865ef tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:20.323181 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-73fc8aad-0ad2-4efb-8522-0c4bd39865ef tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:20.331183 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-73fc8aad-0ad2-4efb-8522-0c4bd39865ef tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.167202 Feb 03 02:59:20.331743 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 262/491] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:20 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:20.524771 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-185e99d0-7fe2-4c80-882f-51b74cc4a2d1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:20.525981 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-185e99d0-7fe2-4c80-882f-51b74cc4a2d1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: d861e845-ecc7-4b5a-85a6-71a9af607f86] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:20.532414 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-185e99d0-7fe2-4c80-882f-51b74cc4a2d1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:20.532896 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-185e99d0-7fe2-4c80-882f-51b74cc4a2d1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:20.533685 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-185e99d0-7fe2-4c80-882f-51b74cc4a2d1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:20.534116 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-185e99d0-7fe2-4c80-882f-51b74cc4a2d1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:20.559945 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-185e99d0-7fe2-4c80-882f-51b74cc4a2d1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: d861e845-ecc7-4b5a-85a6-71a9af607f86] Going to try to terminate instance {{(pid=116385) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 03 02:59:20.642143 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-185e99d0-7fe2-4c80-882f-51b74cc4a2d1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "DELETE /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86" status: 204 len: 0 microversion: 2.1 time: 0.120950 Feb 03 02:59:20.643185 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 230/492] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Feb 3 02:59:20 2022] DELETE /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 03 02:59:20.652580 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-06e05e31-439e-481b-829d-47fc579ae527 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:20.653553 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-06e05e31-439e-481b-829d-47fc579ae527 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: d861e845-ecc7-4b5a-85a6-71a9af607f86] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:20.659650 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-06e05e31-439e-481b-829d-47fc579ae527 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:20.660087 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-06e05e31-439e-481b-829d-47fc579ae527 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:20.660888 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-06e05e31-439e-481b-829d-47fc579ae527 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:20.661316 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-06e05e31-439e-481b-829d-47fc579ae527 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:20.801190 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-06e05e31-439e-481b-829d-47fc579ae527 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:20.808677 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-06e05e31-439e-481b-829d-47fc579ae527 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86" status: 200 len: 1514 microversion: 2.1 time: 0.160877 Feb 03 02:59:20.809305 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 263/493] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:20 2022] GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:21.349087 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-350eaedb-c9ea-4ff6-883e-a4e9d02ed434 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:21.349671 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-350eaedb-c9ea-4ff6-883e-a4e9d02ed434 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:21.357967 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-350eaedb-c9ea-4ff6-883e-a4e9d02ed434 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:21.358582 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-350eaedb-c9ea-4ff6-883e-a4e9d02ed434 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:21.359704 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-350eaedb-c9ea-4ff6-883e-a4e9d02ed434 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:21.360302 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-350eaedb-c9ea-4ff6-883e-a4e9d02ed434 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:21.503472 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-350eaedb-c9ea-4ff6-883e-a4e9d02ed434 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:21.511390 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-350eaedb-c9ea-4ff6-883e-a4e9d02ed434 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.166458 Feb 03 02:59:21.512166 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 231/494] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:21 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:21.826115 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-c5c4ba76-1021-4c43-af7f-59d7fe56fceb tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:21.826690 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-c5c4ba76-1021-4c43-af7f-59d7fe56fceb tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: d861e845-ecc7-4b5a-85a6-71a9af607f86] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:21.833516 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c5c4ba76-1021-4c43-af7f-59d7fe56fceb tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:21.833966 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c5c4ba76-1021-4c43-af7f-59d7fe56fceb tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:21.834747 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c5c4ba76-1021-4c43-af7f-59d7fe56fceb tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:21.835173 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c5c4ba76-1021-4c43-af7f-59d7fe56fceb tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:21.985232 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-c5c4ba76-1021-4c43-af7f-59d7fe56fceb tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:21.992731 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-c5c4ba76-1021-4c43-af7f-59d7fe56fceb tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86" status: 200 len: 1514 microversion: 2.1 time: 0.170464 Feb 03 02:59:21.993311 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 264/495] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:21 2022] GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:22.528343 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-4c65eabe-e97b-4933-b093-5ae1f8402d16 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:22.529062 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-4c65eabe-e97b-4933-b093-5ae1f8402d16 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:22.535785 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4c65eabe-e97b-4933-b093-5ae1f8402d16 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:22.536226 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4c65eabe-e97b-4933-b093-5ae1f8402d16 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:22.537021 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4c65eabe-e97b-4933-b093-5ae1f8402d16 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:22.537446 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4c65eabe-e97b-4933-b093-5ae1f8402d16 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:22.679427 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-4c65eabe-e97b-4933-b093-5ae1f8402d16 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:22.688282 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-4c65eabe-e97b-4933-b093-5ae1f8402d16 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.163502 Feb 03 02:59:22.688877 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 232/496] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:22 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:23.011737 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-b1560e3e-b2e2-4814-b914-cf4b8b30b4e2 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:23.012420 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-b1560e3e-b2e2-4814-b914-cf4b8b30b4e2 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: d861e845-ecc7-4b5a-85a6-71a9af607f86] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:23.019551 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b1560e3e-b2e2-4814-b914-cf4b8b30b4e2 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:23.020004 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b1560e3e-b2e2-4814-b914-cf4b8b30b4e2 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:23.020822 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b1560e3e-b2e2-4814-b914-cf4b8b30b4e2 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:23.021259 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b1560e3e-b2e2-4814-b914-cf4b8b30b4e2 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:23.170909 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-b1560e3e-b2e2-4814-b914-cf4b8b30b4e2 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:23.179125 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-b1560e3e-b2e2-4814-b914-cf4b8b30b4e2 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86" status: 200 len: 1514 microversion: 2.1 time: 0.171849 Feb 03 02:59:23.179703 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 265/497] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:23 2022] GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86 => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:23.705250 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-083df251-e1fc-4c0d-8661-a8462291666b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:23.705846 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-083df251-e1fc-4c0d-8661-a8462291666b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:23.712303 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-083df251-e1fc-4c0d-8661-a8462291666b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:23.712771 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-083df251-e1fc-4c0d-8661-a8462291666b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:23.713708 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-083df251-e1fc-4c0d-8661-a8462291666b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:23.714144 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-083df251-e1fc-4c0d-8661-a8462291666b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:23.850997 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-083df251-e1fc-4c0d-8661-a8462291666b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:23.859426 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-083df251-e1fc-4c0d-8661-a8462291666b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.157807 Feb 03 02:59:23.860004 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 233/498] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:23 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:24.195646 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-3d810b57-c0e2-4192-b62e-55ef4299c0a1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:24.196383 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-3d810b57-c0e2-4192-b62e-55ef4299c0a1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: d861e845-ecc7-4b5a-85a6-71a9af607f86] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:24.203641 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3d810b57-c0e2-4192-b62e-55ef4299c0a1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:24.204115 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3d810b57-c0e2-4192-b62e-55ef4299c0a1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:24.204930 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3d810b57-c0e2-4192-b62e-55ef4299c0a1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:24.205369 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3d810b57-c0e2-4192-b62e-55ef4299c0a1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:24.269369 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-cae864cb-5480-483e-8008-c4ec8fa54e0e req-ee02f620-7209-4a59-8228-de3cf513f5c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d861e845-ecc7-4b5a-85a6-71a9af607f86", "name": "network-vif-deleted", "tag": "716697ab-7116-4750-bb15-40d6691bc75e"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:59:24.271438 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:59:24.271438 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 02:59:24.279924 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-cae864cb-5480-483e-8008-c4ec8fa54e0e req-ee02f620-7209-4a59-8228-de3cf513f5c6 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:24.280357 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-cae864cb-5480-483e-8008-c4ec8fa54e0e req-ee02f620-7209-4a59-8228-de3cf513f5c6 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:24.288257 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-3d810b57-c0e2-4192-b62e-55ef4299c0a1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:24.291915 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-cae864cb-5480-483e-8008-c4ec8fa54e0e req-ee02f620-7209-4a59-8228-de3cf513f5c6 service nova] Creating event network-vif-deleted:716697ab-7116-4750-bb15-40d6691bc75e for instance d861e845-ecc7-4b5a-85a6-71a9af607f86 on hv-cinder-82758 Feb 03 02:59:24.296986 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-cae864cb-5480-483e-8008-c4ec8fa54e0e req-ee02f620-7209-4a59-8228-de3cf513f5c6 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032397 Feb 03 02:59:24.297582 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 234/499] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:59:24.298115 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-3d810b57-c0e2-4192-b62e-55ef4299c0a1 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86" status: 200 len: 1472 microversion: 2.1 time: 0.105202 Feb 03 02:59:24.298773 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 266/500] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:24 2022] GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86 => generated 1472 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:24.879187 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-9e4a66b9-2bf9-43f4-97a9-703bd173eac1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:24.879891 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-9e4a66b9-2bf9-43f4-97a9-703bd173eac1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:24.892072 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9e4a66b9-2bf9-43f4-97a9-703bd173eac1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:24.892496 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9e4a66b9-2bf9-43f4-97a9-703bd173eac1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:24.893551 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9e4a66b9-2bf9-43f4-97a9-703bd173eac1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:24.893912 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9e4a66b9-2bf9-43f4-97a9-703bd173eac1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:25.034063 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-9e4a66b9-2bf9-43f4-97a9-703bd173eac1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:25.045745 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-9e4a66b9-2bf9-43f4-97a9-703bd173eac1 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.173125 Feb 03 02:59:25.046732 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 235/501] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:24 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:25.319169 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-d2c9801e-6968-4927-aca2-7ca4991b2bf9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:25.320221 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-d2c9801e-6968-4927-aca2-7ca4991b2bf9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: d861e845-ecc7-4b5a-85a6-71a9af607f86] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:25.329139 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d2c9801e-6968-4927-aca2-7ca4991b2bf9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:25.329577 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d2c9801e-6968-4927-aca2-7ca4991b2bf9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:25.330375 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d2c9801e-6968-4927-aca2-7ca4991b2bf9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:25.330807 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d2c9801e-6968-4927-aca2-7ca4991b2bf9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:25.344381 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.wsgi [None req-d2c9801e-6968-4927-aca2-7ca4991b2bf9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] HTTP exception thrown: Instance d861e845-ecc7-4b5a-85a6-71a9af607f86 could not be found. Feb 03 02:59:25.344983 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-d2c9801e-6968-4927-aca2-7ca4991b2bf9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Returning 404 to user: Instance d861e845-ecc7-4b5a-85a6-71a9af607f86 could not be found. {{(pid=116386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 02:59:25.345777 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-d2c9801e-6968-4927-aca2-7ca4991b2bf9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86" status: 404 len: 111 microversion: 2.1 time: 0.032964 Feb 03 02:59:25.346288 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 267/502] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:25 2022] GET /compute/v2.1/servers/d861e845-ecc7-4b5a-85a6-71a9af607f86 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 02:59:26.067864 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-d3590949-2597-408b-9bff-fd8a48c3a20b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:26.068454 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-d3590949-2597-408b-9bff-fd8a48c3a20b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:26.075039 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d3590949-2597-408b-9bff-fd8a48c3a20b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:26.075486 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d3590949-2597-408b-9bff-fd8a48c3a20b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:26.076517 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d3590949-2597-408b-9bff-fd8a48c3a20b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:26.077130 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d3590949-2597-408b-9bff-fd8a48c3a20b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:26.222939 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-d3590949-2597-408b-9bff-fd8a48c3a20b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:26.237541 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-d3590949-2597-408b-9bff-fd8a48c3a20b tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.173295 Feb 03 02:59:26.238373 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 236/503] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:26 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:26.485964 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-0c6e8a0d-3d3c-4c03-8d69-8a847b5a4c56 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:26.486472 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-0c6e8a0d-3d3c-4c03-8d69-8a847b5a4c56 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 5db3a24e-6641-4f79-9d50-6b97b67ea6a9] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:26.493266 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0c6e8a0d-3d3c-4c03-8d69-8a847b5a4c56 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:26.493650 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0c6e8a0d-3d3c-4c03-8d69-8a847b5a4c56 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:26.494421 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0c6e8a0d-3d3c-4c03-8d69-8a847b5a4c56 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:26.494926 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0c6e8a0d-3d3c-4c03-8d69-8a847b5a4c56 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:26.520597 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-0c6e8a0d-3d3c-4c03-8d69-8a847b5a4c56 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 5db3a24e-6641-4f79-9d50-6b97b67ea6a9] Going to try to terminate instance {{(pid=116386) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 03 02:59:26.608747 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-0c6e8a0d-3d3c-4c03-8d69-8a847b5a4c56 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "DELETE /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9" status: 204 len: 0 microversion: 2.1 time: 0.126031 Feb 03 02:59:26.610208 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 268/504] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Feb 3 02:59:26 2022] DELETE /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 03 02:59:26.619613 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-82318ac4-8a67-46d4-b5a0-d4ae4696f892 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:26.620223 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-82318ac4-8a67-46d4-b5a0-d4ae4696f892 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 5db3a24e-6641-4f79-9d50-6b97b67ea6a9] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:26.626197 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-82318ac4-8a67-46d4-b5a0-d4ae4696f892 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:26.626643 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-82318ac4-8a67-46d4-b5a0-d4ae4696f892 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:26.627450 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-82318ac4-8a67-46d4-b5a0-d4ae4696f892 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:26.627877 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-82318ac4-8a67-46d4-b5a0-d4ae4696f892 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:26.771184 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-82318ac4-8a67-46d4-b5a0-d4ae4696f892 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:26.778950 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-82318ac4-8a67-46d4-b5a0-d4ae4696f892 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9" status: 200 len: 1513 microversion: 2.1 time: 0.164156 Feb 03 02:59:26.779481 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 237/505] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:26 2022] GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:27.258903 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-80940547-7a36-487b-8b94-d0dfe0e93497 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:27.260044 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-80940547-7a36-487b-8b94-d0dfe0e93497 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:27.270596 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-80940547-7a36-487b-8b94-d0dfe0e93497 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:27.271192 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-80940547-7a36-487b-8b94-d0dfe0e93497 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:27.272704 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-80940547-7a36-487b-8b94-d0dfe0e93497 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:27.273188 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-80940547-7a36-487b-8b94-d0dfe0e93497 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:27.422477 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-80940547-7a36-487b-8b94-d0dfe0e93497 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:27.430679 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-80940547-7a36-487b-8b94-d0dfe0e93497 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.178493 Feb 03 02:59:27.431218 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 269/506] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:27 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:27.795635 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-1a1677f0-92d5-4643-b422-fda98f02cca7 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:27.796203 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-1a1677f0-92d5-4643-b422-fda98f02cca7 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 5db3a24e-6641-4f79-9d50-6b97b67ea6a9] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:27.803004 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1a1677f0-92d5-4643-b422-fda98f02cca7 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:27.803445 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1a1677f0-92d5-4643-b422-fda98f02cca7 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:27.804209 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1a1677f0-92d5-4643-b422-fda98f02cca7 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:27.804671 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1a1677f0-92d5-4643-b422-fda98f02cca7 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:27.952912 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-1a1677f0-92d5-4643-b422-fda98f02cca7 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:27.961533 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-1a1677f0-92d5-4643-b422-fda98f02cca7 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9" status: 200 len: 1513 microversion: 2.1 time: 0.169513 Feb 03 02:59:27.962112 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 238/507] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:27 2022] GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9 => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:28.447871 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-180ddaf0-7e6b-4c14-9d8f-8f5e863f2214 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:28.448491 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-180ddaf0-7e6b-4c14-9d8f-8f5e863f2214 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:28.455478 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-180ddaf0-7e6b-4c14-9d8f-8f5e863f2214 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:28.455928 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-180ddaf0-7e6b-4c14-9d8f-8f5e863f2214 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:28.456763 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-180ddaf0-7e6b-4c14-9d8f-8f5e863f2214 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:28.457177 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-180ddaf0-7e6b-4c14-9d8f-8f5e863f2214 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:28.595238 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-180ddaf0-7e6b-4c14-9d8f-8f5e863f2214 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:28.603886 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-180ddaf0-7e6b-4c14-9d8f-8f5e863f2214 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.159711 Feb 03 02:59:28.604457 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 270/508] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:28 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:28.978283 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-1eaa193a-9307-43f2-87df-27e6e02bf126 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:28.978877 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-1eaa193a-9307-43f2-87df-27e6e02bf126 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 5db3a24e-6641-4f79-9d50-6b97b67ea6a9] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:28.985679 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1eaa193a-9307-43f2-87df-27e6e02bf126 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:28.986126 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1eaa193a-9307-43f2-87df-27e6e02bf126 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:28.986902 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1eaa193a-9307-43f2-87df-27e6e02bf126 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:28.987331 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1eaa193a-9307-43f2-87df-27e6e02bf126 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:29.138575 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-1eaa193a-9307-43f2-87df-27e6e02bf126 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:29.147848 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-1eaa193a-9307-43f2-87df-27e6e02bf126 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9" status: 200 len: 1513 microversion: 2.1 time: 0.173551 Feb 03 02:59:29.157740 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 239/509] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:28 2022] GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9 => generated 1513 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:29.284498 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-47729c0e-a454-4f63-a0f3-a02ab0e6b977 req-d9037074-c421-4acb-836d-6b7b471c0b9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5db3a24e-6641-4f79-9d50-6b97b67ea6a9", "name": "network-vif-deleted", "tag": "eb42ec3a-c180-4e56-94f7-7014b20db64c"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:59:29.286561 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:59:29.286561 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 02:59:29.295963 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-47729c0e-a454-4f63-a0f3-a02ab0e6b977 req-d9037074-c421-4acb-836d-6b7b471c0b9f service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:29.296921 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-47729c0e-a454-4f63-a0f3-a02ab0e6b977 req-d9037074-c421-4acb-836d-6b7b471c0b9f service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:29.311672 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-47729c0e-a454-4f63-a0f3-a02ab0e6b977 req-d9037074-c421-4acb-836d-6b7b471c0b9f service nova] Creating event network-vif-deleted:eb42ec3a-c180-4e56-94f7-7014b20db64c for instance 5db3a24e-6641-4f79-9d50-6b97b67ea6a9 on hv-cinder-82758 Feb 03 02:59:29.317160 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-47729c0e-a454-4f63-a0f3-a02ab0e6b977 req-d9037074-c421-4acb-836d-6b7b471c0b9f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036405 Feb 03 02:59:29.318029 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 271/510] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:59:29.621528 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-5cda3e51-10e3-42b8-a3bf-7cb82a278555 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:29.622093 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-5cda3e51-10e3-42b8-a3bf-7cb82a278555 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:29.628991 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5cda3e51-10e3-42b8-a3bf-7cb82a278555 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:29.629451 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5cda3e51-10e3-42b8-a3bf-7cb82a278555 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:29.630257 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5cda3e51-10e3-42b8-a3bf-7cb82a278555 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:29.630696 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5cda3e51-10e3-42b8-a3bf-7cb82a278555 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:29.774815 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-5cda3e51-10e3-42b8-a3bf-7cb82a278555 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:29.782999 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-5cda3e51-10e3-42b8-a3bf-7cb82a278555 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.165491 Feb 03 02:59:29.783536 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 240/511] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:29 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:30.166706 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-cc55360d-9591-4975-a293-8036fe5eef9e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:30.167262 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-cc55360d-9591-4975-a293-8036fe5eef9e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 5db3a24e-6641-4f79-9d50-6b97b67ea6a9] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:30.174044 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cc55360d-9591-4975-a293-8036fe5eef9e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:30.174490 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cc55360d-9591-4975-a293-8036fe5eef9e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:30.175259 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cc55360d-9591-4975-a293-8036fe5eef9e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:30.175688 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cc55360d-9591-4975-a293-8036fe5eef9e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:30.189663 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.wsgi [None req-cc55360d-9591-4975-a293-8036fe5eef9e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] HTTP exception thrown: Instance 5db3a24e-6641-4f79-9d50-6b97b67ea6a9 could not be found. Feb 03 02:59:30.190237 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-cc55360d-9591-4975-a293-8036fe5eef9e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Returning 404 to user: Instance 5db3a24e-6641-4f79-9d50-6b97b67ea6a9 could not be found. {{(pid=116386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 02:59:30.191049 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-cc55360d-9591-4975-a293-8036fe5eef9e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9" status: 404 len: 111 microversion: 2.1 time: 0.029084 Feb 03 02:59:30.191783 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 272/512] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:30 2022] GET /compute/v2.1/servers/5db3a24e-6641-4f79-9d50-6b97b67ea6a9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 02:59:30.199778 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-0c1f786b-1f01-416a-838c-00346cd3254a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:30.200268 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-0c1f786b-1f01-416a-838c-00346cd3254a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 543ff03e-fd92-42d9-8121-5aa22a1bd45d] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:30.206892 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0c1f786b-1f01-416a-838c-00346cd3254a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:30.207332 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0c1f786b-1f01-416a-838c-00346cd3254a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:30.208113 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0c1f786b-1f01-416a-838c-00346cd3254a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:30.208542 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0c1f786b-1f01-416a-838c-00346cd3254a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:30.234440 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-0c1f786b-1f01-416a-838c-00346cd3254a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 543ff03e-fd92-42d9-8121-5aa22a1bd45d] Going to try to terminate instance {{(pid=116385) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 03 02:59:30.322105 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-0c1f786b-1f01-416a-838c-00346cd3254a tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "DELETE /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d" status: 204 len: 0 microversion: 2.1 time: 0.125581 Feb 03 02:59:30.323093 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 241/513] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Feb 3 02:59:30 2022] DELETE /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 03 02:59:30.331645 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-d1288acd-bf29-4f81-a1ed-7234c29ba0e4 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:30.332249 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-d1288acd-bf29-4f81-a1ed-7234c29ba0e4 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 543ff03e-fd92-42d9-8121-5aa22a1bd45d] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:30.338336 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d1288acd-bf29-4f81-a1ed-7234c29ba0e4 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:30.338775 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d1288acd-bf29-4f81-a1ed-7234c29ba0e4 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:30.339666 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d1288acd-bf29-4f81-a1ed-7234c29ba0e4 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:30.340265 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d1288acd-bf29-4f81-a1ed-7234c29ba0e4 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:30.485991 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-d1288acd-bf29-4f81-a1ed-7234c29ba0e4 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:30.494070 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-d1288acd-bf29-4f81-a1ed-7234c29ba0e4 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d" status: 200 len: 1515 microversion: 2.1 time: 0.166419 Feb 03 02:59:30.494622 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 273/514] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:30 2022] GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:30.804321 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-6e4a90eb-ce87-4160-b13e-bab100db2d84 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:30.805393 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-6e4a90eb-ce87-4160-b13e-bab100db2d84 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:30.814448 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6e4a90eb-ce87-4160-b13e-bab100db2d84 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:30.814896 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6e4a90eb-ce87-4160-b13e-bab100db2d84 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:30.815675 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6e4a90eb-ce87-4160-b13e-bab100db2d84 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:30.816109 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6e4a90eb-ce87-4160-b13e-bab100db2d84 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:30.972303 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-6e4a90eb-ce87-4160-b13e-bab100db2d84 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:30.981049 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-6e4a90eb-ce87-4160-b13e-bab100db2d84 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.183648 Feb 03 02:59:30.981625 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 242/515] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:30 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:31.515138 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-90d4de4e-1dba-4d73-9cca-2787e3af507e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:31.516295 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-90d4de4e-1dba-4d73-9cca-2787e3af507e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 543ff03e-fd92-42d9-8121-5aa22a1bd45d] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:31.528013 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-90d4de4e-1dba-4d73-9cca-2787e3af507e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:31.529010 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-90d4de4e-1dba-4d73-9cca-2787e3af507e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:31.530251 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-90d4de4e-1dba-4d73-9cca-2787e3af507e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:31.531172 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-90d4de4e-1dba-4d73-9cca-2787e3af507e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:31.670129 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-90d4de4e-1dba-4d73-9cca-2787e3af507e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:31.677533 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-90d4de4e-1dba-4d73-9cca-2787e3af507e tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d" status: 200 len: 1515 microversion: 2.1 time: 0.168581 Feb 03 02:59:31.678092 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 274/516] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:31 2022] GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:31.999239 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-6dc12a70-3286-4bd6-81a6-1b86929a5372 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:31.999844 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-6dc12a70-3286-4bd6-81a6-1b86929a5372 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:32.006756 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6dc12a70-3286-4bd6-81a6-1b86929a5372 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:32.007199 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6dc12a70-3286-4bd6-81a6-1b86929a5372 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:32.007973 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6dc12a70-3286-4bd6-81a6-1b86929a5372 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:32.008578 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6dc12a70-3286-4bd6-81a6-1b86929a5372 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:32.150714 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-6dc12a70-3286-4bd6-81a6-1b86929a5372 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:32.161254 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-6dc12a70-3286-4bd6-81a6-1b86929a5372 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.165955 Feb 03 02:59:32.161827 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 243/517] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:31 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:32.686489 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-2776bfce-6418-4ca4-a511-322c5b056c01 req-aa09d6fb-d642-469d-a481-e67170db9e2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "543ff03e-fd92-42d9-8121-5aa22a1bd45d", "name": "network-vif-deleted", "tag": "65f4c02d-138c-4fb0-aae2-8b37b8e7ee12"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:59:32.688033 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:59:32.688033 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 02:59:32.694505 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-8407fc97-fc90-42d5-b76f-e7e9ba1be8d9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:32.695032 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-8407fc97-fc90-42d5-b76f-e7e9ba1be8d9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 543ff03e-fd92-42d9-8121-5aa22a1bd45d] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:32.697248 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-2776bfce-6418-4ca4-a511-322c5b056c01 req-aa09d6fb-d642-469d-a481-e67170db9e2a service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:32.698364 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-2776bfce-6418-4ca4-a511-322c5b056c01 req-aa09d6fb-d642-469d-a481-e67170db9e2a service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:32.703579 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8407fc97-fc90-42d5-b76f-e7e9ba1be8d9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:32.704052 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8407fc97-fc90-42d5-b76f-e7e9ba1be8d9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:32.710340 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-2776bfce-6418-4ca4-a511-322c5b056c01 req-aa09d6fb-d642-469d-a481-e67170db9e2a service nova] Creating event network-vif-deleted:65f4c02d-138c-4fb0-aae2-8b37b8e7ee12 for instance 543ff03e-fd92-42d9-8121-5aa22a1bd45d on hv-cinder-82758 Feb 03 02:59:32.714867 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8407fc97-fc90-42d5-b76f-e7e9ba1be8d9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:32.715670 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8407fc97-fc90-42d5-b76f-e7e9ba1be8d9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:32.716400 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-2776bfce-6418-4ca4-a511-322c5b056c01 req-aa09d6fb-d642-469d-a481-e67170db9e2a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033754 Feb 03 02:59:32.718438 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 275/518] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:59:32.789773 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-8407fc97-fc90-42d5-b76f-e7e9ba1be8d9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:32.797197 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-8407fc97-fc90-42d5-b76f-e7e9ba1be8d9 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d" status: 200 len: 1303 microversion: 2.1 time: 0.106473 Feb 03 02:59:32.797832 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 244/519] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:32 2022] GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:33.179988 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-346eed9d-cde9-4d5b-8e73-fff7ce67a7e0 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:33.180882 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-346eed9d-cde9-4d5b-8e73-fff7ce67a7e0 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:33.188473 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-346eed9d-cde9-4d5b-8e73-fff7ce67a7e0 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:33.189105 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-346eed9d-cde9-4d5b-8e73-fff7ce67a7e0 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:33.189942 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-346eed9d-cde9-4d5b-8e73-fff7ce67a7e0 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:33.190376 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-346eed9d-cde9-4d5b-8e73-fff7ce67a7e0 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:33.333504 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-346eed9d-cde9-4d5b-8e73-fff7ce67a7e0 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:33.341445 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-346eed9d-cde9-4d5b-8e73-fff7ce67a7e0 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.166376 Feb 03 02:59:33.342032 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 276/520] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:33 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:33.818185 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-d3253463-1c69-4a72-83b9-ee1a2506b9ec tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:33.819114 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-d3253463-1c69-4a72-83b9-ee1a2506b9ec tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 543ff03e-fd92-42d9-8121-5aa22a1bd45d] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:33.829848 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d3253463-1c69-4a72-83b9-ee1a2506b9ec tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:33.830619 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d3253463-1c69-4a72-83b9-ee1a2506b9ec tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:33.831886 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d3253463-1c69-4a72-83b9-ee1a2506b9ec tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:33.832589 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d3253463-1c69-4a72-83b9-ee1a2506b9ec tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:33.850867 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.wsgi [None req-d3253463-1c69-4a72-83b9-ee1a2506b9ec tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] HTTP exception thrown: Instance 543ff03e-fd92-42d9-8121-5aa22a1bd45d could not be found. Feb 03 02:59:33.851801 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-d3253463-1c69-4a72-83b9-ee1a2506b9ec tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Returning 404 to user: Instance 543ff03e-fd92-42d9-8121-5aa22a1bd45d could not be found. {{(pid=116385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 02:59:33.852598 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-d3253463-1c69-4a72-83b9-ee1a2506b9ec tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d" status: 404 len: 111 microversion: 2.1 time: 0.040726 Feb 03 02:59:33.853149 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 245/521] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:33 2022] GET /compute/v2.1/servers/543ff03e-fd92-42d9-8121-5aa22a1bd45d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 02:59:34.360323 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-416e048d-8b09-40fb-a104-ee00b02f10e4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:34.361111 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-416e048d-8b09-40fb-a104-ee00b02f10e4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:34.368138 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-416e048d-8b09-40fb-a104-ee00b02f10e4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:34.368581 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-416e048d-8b09-40fb-a104-ee00b02f10e4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:34.369388 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-416e048d-8b09-40fb-a104-ee00b02f10e4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:34.369822 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-416e048d-8b09-40fb-a104-ee00b02f10e4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:34.504904 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-416e048d-8b09-40fb-a104-ee00b02f10e4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:34.513105 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-416e048d-8b09-40fb-a104-ee00b02f10e4 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.157133 Feb 03 02:59:34.513717 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 277/522] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:34 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:34.982373 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-fd44a74d-5638-4758-b2da-d0ec9e822c66 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:34.982875 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-fd44a74d-5638-4758-b2da-d0ec9e822c66 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:34.989616 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fd44a74d-5638-4758-b2da-d0ec9e822c66 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:34.990053 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fd44a74d-5638-4758-b2da-d0ec9e822c66 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:34.990819 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fd44a74d-5638-4758-b2da-d0ec9e822c66 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:34.991243 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fd44a74d-5638-4758-b2da-d0ec9e822c66 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:35.017854 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-fd44a74d-5638-4758-b2da-d0ec9e822c66 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Going to try to terminate instance {{(pid=116385) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 03 02:59:35.092129 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-fd44a74d-5638-4758-b2da-d0ec9e822c66 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "DELETE /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 204 len: 0 microversion: 2.1 time: 0.113042 Feb 03 02:59:35.092671 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 246/523] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Feb 3 02:59:34 2022] DELETE /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 03 02:59:35.101739 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-e82e5dc8-d78a-4b37-b844-d84a758843ae tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:35.102351 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-e82e5dc8-d78a-4b37-b844-d84a758843ae tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:35.108310 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e82e5dc8-d78a-4b37-b844-d84a758843ae tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:35.108796 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e82e5dc8-d78a-4b37-b844-d84a758843ae tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:35.109574 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e82e5dc8-d78a-4b37-b844-d84a758843ae tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:35.110002 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e82e5dc8-d78a-4b37-b844-d84a758843ae tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:35.254127 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-e82e5dc8-d78a-4b37-b844-d84a758843ae tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:35.263138 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-e82e5dc8-d78a-4b37-b844-d84a758843ae tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1515 microversion: 2.1 time: 0.166165 Feb 03 02:59:35.263722 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 278/524] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:35 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:35.530602 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-bb6dca41-6dc3-4d06-b680-f50c782ccbdc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:35.531290 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-bb6dca41-6dc3-4d06-b680-f50c782ccbdc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:35.537717 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bb6dca41-6dc3-4d06-b680-f50c782ccbdc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:35.538160 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bb6dca41-6dc3-4d06-b680-f50c782ccbdc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:35.538942 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bb6dca41-6dc3-4d06-b680-f50c782ccbdc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:35.539380 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bb6dca41-6dc3-4d06-b680-f50c782ccbdc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:35.686115 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-bb6dca41-6dc3-4d06-b680-f50c782ccbdc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:35.694835 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-bb6dca41-6dc3-4d06-b680-f50c782ccbdc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.168303 Feb 03 02:59:35.695406 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 247/525] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:35 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:36.280261 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-e5de8c0a-af02-4ae0-b661-23370a5b6f71 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:36.280998 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-e5de8c0a-af02-4ae0-b661-23370a5b6f71 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:36.288614 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e5de8c0a-af02-4ae0-b661-23370a5b6f71 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:36.289026 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e5de8c0a-af02-4ae0-b661-23370a5b6f71 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:36.289784 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e5de8c0a-af02-4ae0-b661-23370a5b6f71 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:36.290213 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e5de8c0a-af02-4ae0-b661-23370a5b6f71 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:36.427410 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-e5de8c0a-af02-4ae0-b661-23370a5b6f71 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:36.438398 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-e5de8c0a-af02-4ae0-b661-23370a5b6f71 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1515 microversion: 2.1 time: 0.161633 Feb 03 02:59:36.439131 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 279/526] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:36 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:36.716255 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-92f19ca4-44aa-43eb-9e2a-b9b09e0003ea tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:36.717261 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-92f19ca4-44aa-43eb-9e2a-b9b09e0003ea tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:36.725398 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-92f19ca4-44aa-43eb-9e2a-b9b09e0003ea tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:36.725860 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-92f19ca4-44aa-43eb-9e2a-b9b09e0003ea tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:36.727021 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-92f19ca4-44aa-43eb-9e2a-b9b09e0003ea tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:36.727461 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-92f19ca4-44aa-43eb-9e2a-b9b09e0003ea tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:36.871508 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-92f19ca4-44aa-43eb-9e2a-b9b09e0003ea tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:36.879832 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-92f19ca4-44aa-43eb-9e2a-b9b09e0003ea tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.170080 Feb 03 02:59:36.880418 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 248/527] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:36 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:37.460062 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-1f4c7de9-d0ad-49bd-a735-b997fbf92a12 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:37.460674 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-1f4c7de9-d0ad-49bd-a735-b997fbf92a12 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:37.467347 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1f4c7de9-d0ad-49bd-a735-b997fbf92a12 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:37.467891 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1f4c7de9-d0ad-49bd-a735-b997fbf92a12 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:37.468840 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1f4c7de9-d0ad-49bd-a735-b997fbf92a12 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:37.469275 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1f4c7de9-d0ad-49bd-a735-b997fbf92a12 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:37.617014 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-1f4c7de9-d0ad-49bd-a735-b997fbf92a12 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087b5f4f3891413b8b7fa727768c09a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff777728bb704feeabf264e753679daa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:37.625189 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-1f4c7de9-d0ad-49bd-a735-b997fbf92a12 tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 200 len: 1515 microversion: 2.1 time: 0.168935 Feb 03 02:59:37.625796 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 280/528] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:37 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:37.665785 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-6afccc1b-09fa-4136-9e15-0fa84e25572d req-f999a7b5-85b9-49a0-b368-37388fcba355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933b2272-897b-43bc-8ba0-252edeef0170", "name": "network-vif-deleted", "tag": "44de70aa-dd5c-4b82-94f1-25e286c3f42f"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:59:37.667737 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 02:59:37.667737 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 02:59:37.677517 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-6afccc1b-09fa-4136-9e15-0fa84e25572d req-f999a7b5-85b9-49a0-b368-37388fcba355 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:37.677850 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-6afccc1b-09fa-4136-9e15-0fa84e25572d req-f999a7b5-85b9-49a0-b368-37388fcba355 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:37.691064 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-6afccc1b-09fa-4136-9e15-0fa84e25572d req-f999a7b5-85b9-49a0-b368-37388fcba355 service nova] Creating event network-vif-deleted:44de70aa-dd5c-4b82-94f1-25e286c3f42f for instance 933b2272-897b-43bc-8ba0-252edeef0170 on hv-cinder-82758 Feb 03 02:59:37.696433 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-6afccc1b-09fa-4136-9e15-0fa84e25572d req-f999a7b5-85b9-49a0-b368-37388fcba355 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034738 Feb 03 02:59:37.697140 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 249/529] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 02:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:59:37.899594 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-14d55b66-5612-4df7-97be-e5b75580ab42 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:37.900453 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-14d55b66-5612-4df7-97be-e5b75580ab42 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:37.909339 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-14d55b66-5612-4df7-97be-e5b75580ab42 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:37.909973 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-14d55b66-5612-4df7-97be-e5b75580ab42 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:37.911063 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-14d55b66-5612-4df7-97be-e5b75580ab42 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:37.911678 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-14d55b66-5612-4df7-97be-e5b75580ab42 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:38.057459 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-14d55b66-5612-4df7-97be-e5b75580ab42 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:38.065735 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-14d55b66-5612-4df7-97be-e5b75580ab42 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.171576 Feb 03 02:59:38.066767 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 281/530] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:37 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:38.644361 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-a0ec0b48-877d-4e7b-aae4-1a60958d079c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:38.645111 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-a0ec0b48-877d-4e7b-aae4-1a60958d079c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] [instance: 933b2272-897b-43bc-8ba0-252edeef0170] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:38.651665 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a0ec0b48-877d-4e7b-aae4-1a60958d079c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:38.652116 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a0ec0b48-877d-4e7b-aae4-1a60958d079c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:38.652931 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a0ec0b48-877d-4e7b-aae4-1a60958d079c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:38.653366 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a0ec0b48-877d-4e7b-aae4-1a60958d079c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:38.666620 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.wsgi [None req-a0ec0b48-877d-4e7b-aae4-1a60958d079c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] HTTP exception thrown: Instance 933b2272-897b-43bc-8ba0-252edeef0170 could not be found. Feb 03 02:59:38.667238 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-a0ec0b48-877d-4e7b-aae4-1a60958d079c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] Returning 404 to user: Instance 933b2272-897b-43bc-8ba0-252edeef0170 could not be found. {{(pid=116385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 02:59:38.668067 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-a0ec0b48-877d-4e7b-aae4-1a60958d079c tempest-AttachVolumeNegativeTest-859496072 tempest-AttachVolumeNegativeTest-859496072-project] 10.222.0.31 "GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170" status: 404 len: 111 microversion: 2.1 time: 0.029296 Feb 03 02:59:38.668591 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 250/531] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:38 2022] GET /compute/v2.1/servers/933b2272-897b-43bc-8ba0-252edeef0170 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 02:59:39.083383 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-cd80985d-3246-4814-8387-9a7d8bd48710 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:39.084166 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-cd80985d-3246-4814-8387-9a7d8bd48710 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:39.091202 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cd80985d-3246-4814-8387-9a7d8bd48710 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:39.091656 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cd80985d-3246-4814-8387-9a7d8bd48710 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:39.092476 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cd80985d-3246-4814-8387-9a7d8bd48710 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:39.092953 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cd80985d-3246-4814-8387-9a7d8bd48710 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:39.233444 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-cd80985d-3246-4814-8387-9a7d8bd48710 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:39.241464 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-cd80985d-3246-4814-8387-9a7d8bd48710 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.161872 Feb 03 02:59:39.242017 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 282/532] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:39 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:40.258944 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-fd8069c8-db2a-4bd0-93a4-0d1d65e5bb5a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:40.259538 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-fd8069c8-db2a-4bd0-93a4-0d1d65e5bb5a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:40.265744 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fd8069c8-db2a-4bd0-93a4-0d1d65e5bb5a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:40.266179 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fd8069c8-db2a-4bd0-93a4-0d1d65e5bb5a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:40.267036 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fd8069c8-db2a-4bd0-93a4-0d1d65e5bb5a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:40.267630 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fd8069c8-db2a-4bd0-93a4-0d1d65e5bb5a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:40.410088 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-fd8069c8-db2a-4bd0-93a4-0d1d65e5bb5a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:40.419102 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-fd8069c8-db2a-4bd0-93a4-0d1d65e5bb5a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.164041 Feb 03 02:59:40.428376 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 251/533] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:40 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:41.439576 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-d8658e18-7d5c-4f14-a1ee-b188e37f72bc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:41.440347 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-d8658e18-7d5c-4f14-a1ee-b188e37f72bc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:41.447685 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d8658e18-7d5c-4f14-a1ee-b188e37f72bc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:41.448187 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d8658e18-7d5c-4f14-a1ee-b188e37f72bc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:41.449223 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d8658e18-7d5c-4f14-a1ee-b188e37f72bc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:41.449694 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d8658e18-7d5c-4f14-a1ee-b188e37f72bc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:41.585442 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-d8658e18-7d5c-4f14-a1ee-b188e37f72bc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:41.595869 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-d8658e18-7d5c-4f14-a1ee-b188e37f72bc tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.161988 Feb 03 02:59:41.596698 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 283/534] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:41 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:41.715123 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-76fb466c-ec55-4a4a-afe2-6c886973b698 tempest-VolumesTestJSON-1844374781 tempest-VolumesTestJSON-1844374781-project] Calling method '.version_select at 0x7ff99d012f70>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:41.767283 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-76fb466c-ec55-4a4a-afe2-6c886973b698 tempest-VolumesTestJSON-1844374781 tempest-VolumesTestJSON-1844374781-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/c25868d8-488a-4ecd-b1cd-c93c93e50b9b" status: 200 len: 349 microversion: 2.1 time: 0.055638 Feb 03 02:59:41.767853 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 252/535] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Feb 3 02:59:41 2022] GET /compute/v2.1/os-volumes/c25868d8-488a-4ecd-b1cd-c93c93e50b9b => generated 349 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:59:42.614035 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-f787de77-9ca1-4714-b649-1ecf573b5b20 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:42.614675 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-f787de77-9ca1-4714-b649-1ecf573b5b20 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:42.621209 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f787de77-9ca1-4714-b649-1ecf573b5b20 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:42.621663 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f787de77-9ca1-4714-b649-1ecf573b5b20 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:42.622432 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f787de77-9ca1-4714-b649-1ecf573b5b20 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:42.622883 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f787de77-9ca1-4714-b649-1ecf573b5b20 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:42.754918 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-f787de77-9ca1-4714-b649-1ecf573b5b20 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:42.767180 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-f787de77-9ca1-4714-b649-1ecf573b5b20 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.156749 Feb 03 02:59:42.767967 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 284/536] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:42 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:43.110238 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-042f8a12-e196-4aed-af57-1e915e8a4480 tempest-VolumesTestJSON-1844374781 tempest-VolumesTestJSON-1844374781-project] Calling method '.version_select at 0x7ff99cfa6280>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:43.155315 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-042f8a12-e196-4aed-af57-1e915e8a4480 tempest-VolumesTestJSON-1844374781 tempest-VolumesTestJSON-1844374781-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/e9369724-84c7-4115-a7d9-96e8bdb21e9c" status: 200 len: 349 microversion: 2.1 time: 0.049068 Feb 03 02:59:43.155872 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 253/537] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Feb 3 02:59:43 2022] GET /compute/v2.1/os-volumes/e9369724-84c7-4115-a7d9-96e8bdb21e9c => generated 349 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:59:43.788232 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-319562d6-605a-4d81-bbb0-6dfbe32d40c8 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:43.789236 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-319562d6-605a-4d81-bbb0-6dfbe32d40c8 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:43.799261 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-319562d6-605a-4d81-bbb0-6dfbe32d40c8 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:43.799700 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-319562d6-605a-4d81-bbb0-6dfbe32d40c8 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:43.800450 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-319562d6-605a-4d81-bbb0-6dfbe32d40c8 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:43.800940 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-319562d6-605a-4d81-bbb0-6dfbe32d40c8 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:43.939795 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-319562d6-605a-4d81-bbb0-6dfbe32d40c8 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:43.947715 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-319562d6-605a-4d81-bbb0-6dfbe32d40c8 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.165591 Feb 03 02:59:43.948252 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 285/538] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:43 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:44.971636 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-597c2e83-1693-4ea1-9d2e-17f5c726b1ce tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:44.972250 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-597c2e83-1693-4ea1-9d2e-17f5c726b1ce tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:44.979512 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-597c2e83-1693-4ea1-9d2e-17f5c726b1ce tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:44.979980 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-597c2e83-1693-4ea1-9d2e-17f5c726b1ce tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:44.980824 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-597c2e83-1693-4ea1-9d2e-17f5c726b1ce tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:44.981279 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-597c2e83-1693-4ea1-9d2e-17f5c726b1ce tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:45.121638 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-597c2e83-1693-4ea1-9d2e-17f5c726b1ce tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:45.130212 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-597c2e83-1693-4ea1-9d2e-17f5c726b1ce tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.165532 Feb 03 02:59:45.130783 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 254/539] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:44 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:45.657972 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-d9ccdcad-4a1e-4907-97a9-53844125bd48 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:59:45.658573 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-d9ccdcad-4a1e-4907-97a9-53844125bd48 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:45.670407 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d9ccdcad-4a1e-4907-97a9-53844125bd48 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:45.670854 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d9ccdcad-4a1e-4907-97a9-53844125bd48 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:45.671722 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d9ccdcad-4a1e-4907-97a9-53844125bd48 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:45.672155 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d9ccdcad-4a1e-4907-97a9-53844125bd48 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:45.695738 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.objects.instance [None req-d9ccdcad-4a1e-4907-97a9-53844125bd48 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lazy-loading 'flavor' on Instance uuid e0708ed4-206d-484e-a2b4-dfb7733d415b {{(pid=116386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 03 02:59:45.959356 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-d9ccdcad-4a1e-4907-97a9-53844125bd48 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "POST /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b/action" status: 202 len: 0 microversion: 2.20 time: 0.305354 Feb 03 02:59:45.959975 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 286/540] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Feb 3 02:59:45 2022] POST /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 03 02:59:45.972523 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-ff2b20e5-7535-495c-95bb-2984f916d94d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:45.973647 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-ff2b20e5-7535-495c-95bb-2984f916d94d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:45.988570 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ff2b20e5-7535-495c-95bb-2984f916d94d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:45.989177 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ff2b20e5-7535-495c-95bb-2984f916d94d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:45.990169 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ff2b20e5-7535-495c-95bb-2984f916d94d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:45.990731 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ff2b20e5-7535-495c-95bb-2984f916d94d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:46.147640 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-7bf673c2-fc14-4a67-865d-f86a81dbc08d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:46.148350 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-7bf673c2-fc14-4a67-865d-f86a81dbc08d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:46.151092 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-ff2b20e5-7535-495c-95bb-2984f916d94d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:46.154842 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7bf673c2-fc14-4a67-865d-f86a81dbc08d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:46.155281 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7bf673c2-fc14-4a67-865d-f86a81dbc08d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:46.156082 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7bf673c2-fc14-4a67-865d-f86a81dbc08d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:46.156504 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7bf673c2-fc14-4a67-865d-f86a81dbc08d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:46.158860 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-ff2b20e5-7535-495c-95bb-2984f916d94d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:46.160324 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-ff2b20e5-7535-495c-95bb-2984f916d94d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:46.161473 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-ff2b20e5-7535-495c-95bb-2984f916d94d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1723 microversion: 2.20 time: 0.196648 Feb 03 02:59:46.162322 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 255/541] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 02:59:45 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 02:59:46.291430 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-7bf673c2-fc14-4a67-865d-f86a81dbc08d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:46.299763 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-7bf673c2-fc14-4a67-865d-f86a81dbc08d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.156186 Feb 03 02:59:46.300319 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 287/542] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:46 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:59:46.572278 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-a9e72070-9280-4562-904e-e10918327448 tempest-VolumesTestJSON-1844374781 tempest-VolumesTestJSON-1844374781-project] Calling method '.version_select at 0x7ff99d19bd30>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:46.617695 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-a9e72070-9280-4562-904e-e10918327448 tempest-VolumesTestJSON-1844374781 tempest-VolumesTestJSON-1844374781-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/d92c2aeb-b235-4197-9cd6-2f5f2bb267de" status: 200 len: 350 microversion: 2.1 time: 0.048985 Feb 03 02:59:46.618254 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 256/543] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Feb 3 02:59:46 2022] GET /compute/v2.1/os-volumes/d92c2aeb-b235-4197-9cd6-2f5f2bb267de => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:59:46.629619 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-4b03029b-1e74-48b3-82e3-a2e1d0c02a39 tempest-VolumesTestJSON-1844374781 tempest-VolumesTestJSON-1844374781-project] Calling method '.version_select at 0x7ff99cf6e040>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:46.715842 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-4b03029b-1e74-48b3-82e3-a2e1d0c02a39 tempest-VolumesTestJSON-1844374781 tempest-VolumesTestJSON-1844374781-project] 10.222.0.31 "GET /compute/v2.1/os-volumes" status: 200 len: 1031 microversion: 2.1 time: 0.090205 Feb 03 02:59:46.717106 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 288/544] 10.222.0.31 () {58 vars in 1133 bytes} [Thu Feb 3 02:59:46 2022] GET /compute/v2.1/os-volumes => generated 1031 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:46.729611 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-b7d2e610-581f-423c-8728-2b3e67e1a95d tempest-VolumesTestJSON-1844374781 tempest-VolumesTestJSON-1844374781-project] Calling method '.version_select at 0x7ff99d1a1e50>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:46.805953 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-b7d2e610-581f-423c-8728-2b3e67e1a95d tempest-VolumesTestJSON-1844374781 tempest-VolumesTestJSON-1844374781-project] 10.222.0.31 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.080199 Feb 03 02:59:46.806534 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 257/545] 10.222.0.31 () {58 vars in 1148 bytes} [Thu Feb 3 02:59:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:59:46.818576 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-1e4da4d7-b400-4637-b029-b0bf081c9537 tempest-VolumesTestJSON-1844374781 tempest-VolumesTestJSON-1844374781-project] Calling method '.version_select at 0x7ff99cfa83a0>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:46.897985 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-1e4da4d7-b400-4637-b029-b0bf081c9537 tempest-VolumesTestJSON-1844374781 tempest-VolumesTestJSON-1844374781-project] 10.222.0.31 "GET /compute/v2.1/os-volumes" status: 200 len: 1031 microversion: 2.1 time: 0.083162 Feb 03 02:59:46.898553 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 289/546] 10.222.0.31 () {58 vars in 1133 bytes} [Thu Feb 3 02:59:46 2022] GET /compute/v2.1/os-volumes => generated 1031 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:46.909657 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-eeafadbe-c431-4bf9-ab3d-23fd34f7a6be tempest-VolumesTestJSON-1844374781 tempest-VolumesTestJSON-1844374781-project] Calling method '.version_select at 0x7ff99d0e79d0>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:46.992032 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-eeafadbe-c431-4bf9-ab3d-23fd34f7a6be tempest-VolumesTestJSON-1844374781 tempest-VolumesTestJSON-1844374781-project] 10.222.0.31 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.085897 Feb 03 02:59:46.992616 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 258/547] 10.222.0.31 () {58 vars in 1166 bytes} [Thu Feb 3 02:59:46 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:59:47.004319 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-9ef98c18-0890-4be6-99d2-a83f5b7d8e27 tempest-VolumesTestJSON-1844374781 tempest-VolumesTestJSON-1844374781-project] Calling method '.version_select at 0x7ff99cf85a60>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:47.081039 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-9ef98c18-0890-4be6-99d2-a83f5b7d8e27 tempest-VolumesTestJSON-1844374781 tempest-VolumesTestJSON-1844374781-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.080290 Feb 03 02:59:47.081608 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 290/548] 10.222.0.31 () {58 vars in 1169 bytes} [Thu Feb 3 02:59:46 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 03 02:59:47.093361 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-bc630d4e-1957-46f0-8cbc-7ef7e148b54a tempest-VolumesTestJSON-1844374781 tempest-VolumesTestJSON-1844374781-project] Calling method '.version_select at 0x7ff99d0e7dc0>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:47.172006 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-bc630d4e-1957-46f0-8cbc-7ef7e148b54a tempest-VolumesTestJSON-1844374781 tempest-VolumesTestJSON-1844374781-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1031 microversion: 2.1 time: 0.082160 Feb 03 02:59:47.172553 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 259/549] 10.222.0.31 () {58 vars in 1154 bytes} [Thu Feb 3 02:59:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1031 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:47.180128 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-86ba37d9-8149-401f-936e-217e1010f9d6 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:47.180745 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-86ba37d9-8149-401f-936e-217e1010f9d6 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:47.183450 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-44d5f5eb-89be-4851-bd8a-746baba82bad tempest-VolumesTestJSON-1844374781 tempest-VolumesTestJSON-1844374781-project] Calling method '.version_select at 0x7ff99d176d30>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:47.187007 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-86ba37d9-8149-401f-936e-217e1010f9d6 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:47.187474 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-86ba37d9-8149-401f-936e-217e1010f9d6 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:47.188252 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-86ba37d9-8149-401f-936e-217e1010f9d6 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:47.188787 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-86ba37d9-8149-401f-936e-217e1010f9d6 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:47.263826 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-44d5f5eb-89be-4851-bd8a-746baba82bad tempest-VolumesTestJSON-1844374781 tempest-VolumesTestJSON-1844374781-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.083771 Feb 03 02:59:47.264390 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 260/550] 10.222.0.31 () {58 vars in 1187 bytes} [Thu Feb 3 02:59:47 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:59:47.275756 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-2b400984-c33e-4bc2-aa17-3958eb81b651 tempest-VolumesTestJSON-1844374781 tempest-VolumesTestJSON-1844374781-project] Calling method '.version_select at 0x7ff99db7c790>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:47.332125 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-86ba37d9-8149-401f-936e-217e1010f9d6 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:47.341999 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-86ba37d9-8149-401f-936e-217e1010f9d6 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:47.343481 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-86ba37d9-8149-401f-936e-217e1010f9d6 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:47.344584 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-86ba37d9-8149-401f-936e-217e1010f9d6 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1723 microversion: 2.20 time: 0.168988 Feb 03 02:59:47.345236 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 291/551] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 02:59:47 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 02:59:47.349724 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-88d6e21d-63fb-41ed-8743-743f5d603472 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:47.350305 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-88d6e21d-63fb-41ed-8743-743f5d603472 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:47.356800 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-88d6e21d-63fb-41ed-8743-743f5d603472 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:47.357248 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-88d6e21d-63fb-41ed-8743-743f5d603472 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:47.357394 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-2b400984-c33e-4bc2-aa17-3958eb81b651 tempest-VolumesTestJSON-1844374781 tempest-VolumesTestJSON-1844374781-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1031 microversion: 2.1 time: 0.085238 Feb 03 02:59:47.357990 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 261/552] 10.222.0.31 () {58 vars in 1154 bytes} [Thu Feb 3 02:59:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1031 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:59:47.358130 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-88d6e21d-63fb-41ed-8743-743f5d603472 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:47.358537 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-88d6e21d-63fb-41ed-8743-743f5d603472 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:47.495647 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-88d6e21d-63fb-41ed-8743-743f5d603472 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:47.504155 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-88d6e21d-63fb-41ed-8743-743f5d603472 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.157985 Feb 03 02:59:47.504747 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 292/553] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:47 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:48.368394 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-614f02c6-4de4-46b4-b3fc-ab23a3645e2e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:48.369336 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-614f02c6-4de4-46b4-b3fc-ab23a3645e2e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:48.379709 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-614f02c6-4de4-46b4-b3fc-ab23a3645e2e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:48.380456 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-614f02c6-4de4-46b4-b3fc-ab23a3645e2e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:48.381878 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-614f02c6-4de4-46b4-b3fc-ab23a3645e2e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:48.382511 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-614f02c6-4de4-46b4-b3fc-ab23a3645e2e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:48.520537 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-84478478-c68b-4d27-b8cb-62a48e5bf731 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:48.521319 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-84478478-c68b-4d27-b8cb-62a48e5bf731 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:48.526205 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-614f02c6-4de4-46b4-b3fc-ab23a3645e2e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:48.527975 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-84478478-c68b-4d27-b8cb-62a48e5bf731 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:48.528429 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-84478478-c68b-4d27-b8cb-62a48e5bf731 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:48.529253 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-84478478-c68b-4d27-b8cb-62a48e5bf731 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:48.529699 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-84478478-c68b-4d27-b8cb-62a48e5bf731 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:48.534472 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-614f02c6-4de4-46b4-b3fc-ab23a3645e2e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:48.536033 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-614f02c6-4de4-46b4-b3fc-ab23a3645e2e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:48.537297 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-614f02c6-4de4-46b4-b3fc-ab23a3645e2e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1723 microversion: 2.20 time: 0.176085 Feb 03 02:59:48.537924 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 262/554] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 02:59:48 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 02:59:48.669383 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-84478478-c68b-4d27-b8cb-62a48e5bf731 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:48.681364 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-84478478-c68b-4d27-b8cb-62a48e5bf731 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.164701 Feb 03 02:59:48.681899 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 293/555] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:48 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:49.555407 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-03e9da6f-9cbc-4dda-b9af-4f80880592fc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:49.556122 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-03e9da6f-9cbc-4dda-b9af-4f80880592fc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:49.562961 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-03e9da6f-9cbc-4dda-b9af-4f80880592fc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:49.563452 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-03e9da6f-9cbc-4dda-b9af-4f80880592fc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:49.564232 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-03e9da6f-9cbc-4dda-b9af-4f80880592fc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:49.564658 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-03e9da6f-9cbc-4dda-b9af-4f80880592fc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:49.697974 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-f175d3eb-a753-492f-9d69-2fb858a0f0ea tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:49.698762 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-f175d3eb-a753-492f-9d69-2fb858a0f0ea tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:49.704250 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-03e9da6f-9cbc-4dda-b9af-4f80880592fc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:49.705472 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f175d3eb-a753-492f-9d69-2fb858a0f0ea tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:49.705916 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f175d3eb-a753-492f-9d69-2fb858a0f0ea tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:49.706690 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f175d3eb-a753-492f-9d69-2fb858a0f0ea tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:49.707122 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f175d3eb-a753-492f-9d69-2fb858a0f0ea tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:49.712764 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-03e9da6f-9cbc-4dda-b9af-4f80880592fc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:49.714217 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-03e9da6f-9cbc-4dda-b9af-4f80880592fc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:49.715389 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-03e9da6f-9cbc-4dda-b9af-4f80880592fc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1723 microversion: 2.20 time: 0.163825 Feb 03 02:59:49.715961 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 263/556] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 02:59:49 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 02:59:49.845574 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-f175d3eb-a753-492f-9d69-2fb858a0f0ea tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:49.858372 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-f175d3eb-a753-492f-9d69-2fb858a0f0ea tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1565 microversion: 2.1 time: 0.163820 Feb 03 02:59:49.859212 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 294/557] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:49 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:50.734547 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-0fa223a5-f541-4674-b1c9-673c29c59499 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:50.735247 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-0fa223a5-f541-4674-b1c9-673c29c59499 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:50.741956 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0fa223a5-f541-4674-b1c9-673c29c59499 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:50.742397 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0fa223a5-f541-4674-b1c9-673c29c59499 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:50.743162 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0fa223a5-f541-4674-b1c9-673c29c59499 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:50.743585 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0fa223a5-f541-4674-b1c9-673c29c59499 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:50.878271 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-0fa223a5-f541-4674-b1c9-673c29c59499 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:50.882717 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-a35da8b6-d674-48bc-ac5b-d0f4f34478ea tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:50.883402 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-a35da8b6-d674-48bc-ac5b-d0f4f34478ea tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:50.891052 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-0fa223a5-f541-4674-b1c9-673c29c59499 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:50.892562 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-0fa223a5-f541-4674-b1c9-673c29c59499 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:50.893757 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-0fa223a5-f541-4674-b1c9-673c29c59499 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1723 microversion: 2.20 time: 0.163007 Feb 03 02:59:50.894309 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 264/558] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 02:59:50 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 02:59:50.897627 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a35da8b6-d674-48bc-ac5b-d0f4f34478ea tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:50.898213 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a35da8b6-d674-48bc-ac5b-d0f4f34478ea tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:50.899159 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a35da8b6-d674-48bc-ac5b-d0f4f34478ea tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:50.899663 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a35da8b6-d674-48bc-ac5b-d0f4f34478ea tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:51.043720 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-a35da8b6-d674-48bc-ac5b-d0f4f34478ea tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:51.053459 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-a35da8b6-d674-48bc-ac5b-d0f4f34478ea tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1545 microversion: 2.1 time: 0.181774 Feb 03 02:59:51.054026 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 295/559] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:50 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1545 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:59:51.070531 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-69d8fcba-a80a-4264-b3f2-4208b0aed996 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:51.071154 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-69d8fcba-a80a-4264-b3f2-4208b0aed996 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:51.079313 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-69d8fcba-a80a-4264-b3f2-4208b0aed996 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:51.079767 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-69d8fcba-a80a-4264-b3f2-4208b0aed996 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:51.080533 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-69d8fcba-a80a-4264-b3f2-4208b0aed996 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:51.080996 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-69d8fcba-a80a-4264-b3f2-4208b0aed996 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:51.162762 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.wsgi [None req-69d8fcba-a80a-4264-b3f2-4208b0aed996 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] HTTP exception thrown: Cannot 'detach_volume' instance 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e while it is in vm_state rescued Feb 03 02:59:51.163351 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-69d8fcba-a80a-4264-b3f2-4208b0aed996 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Returning 409 to user: Cannot 'detach_volume' instance 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e while it is in vm_state rescued {{(pid=116385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 02:59:51.164172 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-69d8fcba-a80a-4264-b3f2-4208b0aed996 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "DELETE /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e/os-volume_attachments/fe687108-a88a-428f-bdc6-a4535c9eaf39" status: 409 len: 152 microversion: 2.1 time: 0.097683 Feb 03 02:59:51.164693 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 265/560] 10.222.0.31 () {58 vars in 1415 bytes} [Thu Feb 3 02:59:51 2022] DELETE /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e/os-volume_attachments/fe687108-a88a-428f-bdc6-a4535c9eaf39 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 03 02:59:51.173102 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-494b2656-b359-4f02-af03-b3887b4ba044 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 02:59:51.173624 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-494b2656-b359-4f02-af03-b3887b4ba044 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:51.179544 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-494b2656-b359-4f02-af03-b3887b4ba044 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:51.179975 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-494b2656-b359-4f02-af03-b3887b4ba044 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:51.180755 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-494b2656-b359-4f02-af03-b3887b4ba044 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:51.181237 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-494b2656-b359-4f02-af03-b3887b4ba044 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:51.248915 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-494b2656-b359-4f02-af03-b3887b4ba044 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "POST /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e/action" status: 202 len: 0 microversion: 2.1 time: 0.079345 Feb 03 02:59:51.249538 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 296/561] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Feb 3 02:59:51 2022] POST /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 03 02:59:51.258915 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-168ce0af-2475-4d65-a635-03cd44b0b4a5 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:51.259504 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-168ce0af-2475-4d65-a635-03cd44b0b4a5 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:51.266153 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-168ce0af-2475-4d65-a635-03cd44b0b4a5 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:51.266619 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-168ce0af-2475-4d65-a635-03cd44b0b4a5 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:51.267352 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-168ce0af-2475-4d65-a635-03cd44b0b4a5 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:51.267952 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-168ce0af-2475-4d65-a635-03cd44b0b4a5 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:51.406970 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-168ce0af-2475-4d65-a635-03cd44b0b4a5 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:51.419928 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-168ce0af-2475-4d65-a635-03cd44b0b4a5 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1553 microversion: 2.1 time: 0.164367 Feb 03 02:59:51.420766 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 266/562] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:51 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:59:51.916749 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-8f5ea02e-502c-49b3-b5cd-baaebfe3fb76 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:51.917598 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-8f5ea02e-502c-49b3-b5cd-baaebfe3fb76 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:51.925107 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8f5ea02e-502c-49b3-b5cd-baaebfe3fb76 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:51.925619 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8f5ea02e-502c-49b3-b5cd-baaebfe3fb76 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:51.926512 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8f5ea02e-502c-49b3-b5cd-baaebfe3fb76 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:51.927023 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8f5ea02e-502c-49b3-b5cd-baaebfe3fb76 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:52.063958 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-8f5ea02e-502c-49b3-b5cd-baaebfe3fb76 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:52.071865 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-8f5ea02e-502c-49b3-b5cd-baaebfe3fb76 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:52.073376 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-8f5ea02e-502c-49b3-b5cd-baaebfe3fb76 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:52.074530 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-8f5ea02e-502c-49b3-b5cd-baaebfe3fb76 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1723 microversion: 2.20 time: 0.163158 Feb 03 02:59:52.075080 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 297/563] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 02:59:51 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 02:59:52.439248 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-ecfe2a88-66ae-4de6-952d-8a9c1b07d1b2 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:52.439858 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-ecfe2a88-66ae-4de6-952d-8a9c1b07d1b2 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:52.446552 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ecfe2a88-66ae-4de6-952d-8a9c1b07d1b2 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:52.447004 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ecfe2a88-66ae-4de6-952d-8a9c1b07d1b2 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:52.447781 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ecfe2a88-66ae-4de6-952d-8a9c1b07d1b2 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:52.448273 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ecfe2a88-66ae-4de6-952d-8a9c1b07d1b2 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:52.596240 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-ecfe2a88-66ae-4de6-952d-8a9c1b07d1b2 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:52.603721 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-ecfe2a88-66ae-4de6-952d-8a9c1b07d1b2 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1553 microversion: 2.1 time: 0.168256 Feb 03 02:59:52.604295 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 267/564] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:52 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:53.094696 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-e94514b5-de04-4a1b-93ca-0f650011e1da tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:53.095237 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-e94514b5-de04-4a1b-93ca-0f650011e1da tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:53.102561 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e94514b5-de04-4a1b-93ca-0f650011e1da tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:53.103002 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e94514b5-de04-4a1b-93ca-0f650011e1da tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:53.103775 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e94514b5-de04-4a1b-93ca-0f650011e1da tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:53.104197 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e94514b5-de04-4a1b-93ca-0f650011e1da tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:53.250871 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-e94514b5-de04-4a1b-93ca-0f650011e1da tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:53.259577 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-e94514b5-de04-4a1b-93ca-0f650011e1da tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:53.261107 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-e94514b5-de04-4a1b-93ca-0f650011e1da tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:53.262284 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-e94514b5-de04-4a1b-93ca-0f650011e1da tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1723 microversion: 2.20 time: 0.171460 Feb 03 02:59:53.262842 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 298/565] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 02:59:53 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 02:59:53.624798 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-deaef503-3d51-467d-b4e3-574292c4715d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:53.625740 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-deaef503-3d51-467d-b4e3-574292c4715d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:53.633838 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-deaef503-3d51-467d-b4e3-574292c4715d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:53.634280 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-deaef503-3d51-467d-b4e3-574292c4715d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:53.635059 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-deaef503-3d51-467d-b4e3-574292c4715d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:53.635479 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-deaef503-3d51-467d-b4e3-574292c4715d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:53.794875 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-deaef503-3d51-467d-b4e3-574292c4715d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:53.805422 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-deaef503-3d51-467d-b4e3-574292c4715d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1553 microversion: 2.1 time: 0.186152 Feb 03 02:59:53.806172 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 268/566] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:53 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1553 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:54.281097 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-4fdca898-54fd-46ba-8b66-641d16776981 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:54.281680 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-4fdca898-54fd-46ba-8b66-641d16776981 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:54.288227 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4fdca898-54fd-46ba-8b66-641d16776981 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:54.288665 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4fdca898-54fd-46ba-8b66-641d16776981 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:54.289469 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4fdca898-54fd-46ba-8b66-641d16776981 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:54.289897 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4fdca898-54fd-46ba-8b66-641d16776981 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:54.426631 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-4fdca898-54fd-46ba-8b66-641d16776981 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:54.437622 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-4fdca898-54fd-46ba-8b66-641d16776981 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:54.439240 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-4fdca898-54fd-46ba-8b66-641d16776981 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:54.440942 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-4fdca898-54fd-46ba-8b66-641d16776981 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1723 microversion: 2.20 time: 0.163541 Feb 03 02:59:54.441783 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 299/567] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 02:59:54 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 02:59:54.825487 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-9254f302-dc69-4f72-8b1f-2aceefaa683e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:54.826093 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-9254f302-dc69-4f72-8b1f-2aceefaa683e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:54.832961 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9254f302-dc69-4f72-8b1f-2aceefaa683e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:54.833407 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9254f302-dc69-4f72-8b1f-2aceefaa683e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:54.834177 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9254f302-dc69-4f72-8b1f-2aceefaa683e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:54.834603 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9254f302-dc69-4f72-8b1f-2aceefaa683e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:54.982499 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-9254f302-dc69-4f72-8b1f-2aceefaa683e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:54.990484 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-9254f302-dc69-4f72-8b1f-2aceefaa683e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1553 microversion: 2.1 time: 0.168694 Feb 03 02:59:54.991057 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 269/568] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:54 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:55.459197 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-06e91e6e-80dd-4332-88a9-fdc6a358185a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:55.460885 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-06e91e6e-80dd-4332-88a9-fdc6a358185a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:55.467890 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-06e91e6e-80dd-4332-88a9-fdc6a358185a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:55.468997 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-06e91e6e-80dd-4332-88a9-fdc6a358185a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:55.470286 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-06e91e6e-80dd-4332-88a9-fdc6a358185a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:55.470931 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-06e91e6e-80dd-4332-88a9-fdc6a358185a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:55.695247 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-06e91e6e-80dd-4332-88a9-fdc6a358185a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:55.710461 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-06e91e6e-80dd-4332-88a9-fdc6a358185a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:55.712084 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-06e91e6e-80dd-4332-88a9-fdc6a358185a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:55.713257 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-06e91e6e-80dd-4332-88a9-fdc6a358185a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1723 microversion: 2.20 time: 0.258068 Feb 03 02:59:55.713995 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 300/569] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 02:59:55 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 03 02:59:56.007149 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-88faddbb-09be-406e-8775-5cf61eb78b3c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:56.007779 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-88faddbb-09be-406e-8775-5cf61eb78b3c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:56.014116 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-88faddbb-09be-406e-8775-5cf61eb78b3c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:56.014576 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-88faddbb-09be-406e-8775-5cf61eb78b3c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:56.015361 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-88faddbb-09be-406e-8775-5cf61eb78b3c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:56.015785 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-88faddbb-09be-406e-8775-5cf61eb78b3c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:56.156950 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-88faddbb-09be-406e-8775-5cf61eb78b3c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:56.164967 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-88faddbb-09be-406e-8775-5cf61eb78b3c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1553 microversion: 2.1 time: 0.161440 Feb 03 02:59:56.171964 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 270/570] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:56 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 02:59:56.731832 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-2e7b724e-7359-47b2-91ee-f30c203ebaa9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:56.732890 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-2e7b724e-7359-47b2-91ee-f30c203ebaa9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:56.739579 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2e7b724e-7359-47b2-91ee-f30c203ebaa9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:56.740187 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2e7b724e-7359-47b2-91ee-f30c203ebaa9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:56.741094 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2e7b724e-7359-47b2-91ee-f30c203ebaa9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:56.741606 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2e7b724e-7359-47b2-91ee-f30c203ebaa9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:56.893163 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-2e7b724e-7359-47b2-91ee-f30c203ebaa9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:56.903396 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-2e7b724e-7359-47b2-91ee-f30c203ebaa9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:56.904998 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-2e7b724e-7359-47b2-91ee-f30c203ebaa9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:56.906153 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-2e7b724e-7359-47b2-91ee-f30c203ebaa9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1723 microversion: 2.20 time: 0.178174 Feb 03 02:59:56.906920 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 301/571] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 02:59:56 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 02:59:57.182217 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-fe6e40db-c514-491b-a945-45162356f2fa tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:57.182839 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-fe6e40db-c514-491b-a945-45162356f2fa tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:57.190006 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fe6e40db-c514-491b-a945-45162356f2fa tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:57.190455 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fe6e40db-c514-491b-a945-45162356f2fa tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:57.191257 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fe6e40db-c514-491b-a945-45162356f2fa tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:57.191868 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fe6e40db-c514-491b-a945-45162356f2fa tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:57.329380 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-fe6e40db-c514-491b-a945-45162356f2fa tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:57.337834 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-fe6e40db-c514-491b-a945-45162356f2fa tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1559 microversion: 2.1 time: 0.159420 Feb 03 02:59:57.338365 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 271/572] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 02:59:57 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 02:59:57.405180 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-35f9e390-f295-46c2-87b7-4cea8b051328 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:57.405556 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-35f9e390-f295-46c2-87b7-4cea8b051328 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:57.411393 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-35f9e390-f295-46c2-87b7-4cea8b051328 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:57.411778 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-35f9e390-f295-46c2-87b7-4cea8b051328 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:57.412552 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-35f9e390-f295-46c2-87b7-4cea8b051328 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:57.413014 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-35f9e390-f295-46c2-87b7-4cea8b051328 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:57.489874 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.objects.instance [None req-35f9e390-f295-46c2-87b7-4cea8b051328 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lazy-loading 'services' on Instance uuid 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e {{(pid=116386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 03 02:59:57.558883 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-35f9e390-f295-46c2-87b7-4cea8b051328 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "DELETE /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e/os-volume_attachments/fe687108-a88a-428f-bdc6-a4535c9eaf39" status: 202 len: 0 microversion: 2.1 time: 0.157341 Feb 03 02:59:57.559482 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 302/573] 10.222.0.31 () {58 vars in 1415 bytes} [Thu Feb 3 02:59:57 2022] DELETE /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e/os-volume_attachments/fe687108-a88a-428f-bdc6-a4535c9eaf39 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 03 02:59:57.574911 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-6403676a-d480-4d2e-b1f1-438feee2212f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:57.577873 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-6403676a-d480-4d2e-b1f1-438feee2212f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:57.586228 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6403676a-d480-4d2e-b1f1-438feee2212f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:57.587594 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6403676a-d480-4d2e-b1f1-438feee2212f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:57.588609 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6403676a-d480-4d2e-b1f1-438feee2212f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:57.589252 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6403676a-d480-4d2e-b1f1-438feee2212f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:57.625484 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-6403676a-d480-4d2e-b1f1-438feee2212f tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061296 Feb 03 02:59:57.626327 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 272/574] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Feb 3 02:59:57 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 02:59:57.926090 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-48f1ac30-3583-4025-bc94-d72d3a2853fa tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:57.927817 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-48f1ac30-3583-4025-bc94-d72d3a2853fa tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:57.935194 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-48f1ac30-3583-4025-bc94-d72d3a2853fa tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:57.936134 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-48f1ac30-3583-4025-bc94-d72d3a2853fa tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:57.936974 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-48f1ac30-3583-4025-bc94-d72d3a2853fa tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:57.937547 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-48f1ac30-3583-4025-bc94-d72d3a2853fa tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:58.380561 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-48f1ac30-3583-4025-bc94-d72d3a2853fa tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:58.401525 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-48f1ac30-3583-4025-bc94-d72d3a2853fa tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:58.403403 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-48f1ac30-3583-4025-bc94-d72d3a2853fa tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:58.405007 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-48f1ac30-3583-4025-bc94-d72d3a2853fa tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1723 microversion: 2.20 time: 0.483559 Feb 03 02:59:58.405788 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 303/575] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 02:59:57 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1723 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 02:59:58.637497 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-8baa51be-5d80-4ee9-a492-5704112489b3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:58.638392 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-8baa51be-5d80-4ee9-a492-5704112489b3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:58.645204 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8baa51be-5d80-4ee9-a492-5704112489b3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:58.645655 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8baa51be-5d80-4ee9-a492-5704112489b3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:58.646435 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8baa51be-5d80-4ee9-a492-5704112489b3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:58.646842 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8baa51be-5d80-4ee9-a492-5704112489b3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:58.678912 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-8baa51be-5d80-4ee9-a492-5704112489b3 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045217 Feb 03 02:59:58.679647 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 273/576] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Feb 3 02:59:58 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 03 02:59:59.423677 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-54b3ddb4-6841-443a-8fdd-65a190e8060e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 02:59:59.424354 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-54b3ddb4-6841-443a-8fdd-65a190e8060e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 02:59:59.433291 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-54b3ddb4-6841-443a-8fdd-65a190e8060e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:59.433731 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-54b3ddb4-6841-443a-8fdd-65a190e8060e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:59.434502 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-54b3ddb4-6841-443a-8fdd-65a190e8060e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 02:59:59.434923 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-54b3ddb4-6841-443a-8fdd-65a190e8060e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 02:59:59.582180 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-54b3ddb4-6841-443a-8fdd-65a190e8060e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:59.590606 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-54b3ddb4-6841-443a-8fdd-65a190e8060e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:59.592114 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-54b3ddb4-6841-443a-8fdd-65a190e8060e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 02:59:59.593289 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-54b3ddb4-6841-443a-8fdd-65a190e8060e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1723 microversion: 2.20 time: 0.173510 Feb 03 02:59:59.593824 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 304/577] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 02:59:59 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:00.612682 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-0b05e958-a9fd-4451-b311-83cc07d17eb7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:00.614247 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-0b05e958-a9fd-4451-b311-83cc07d17eb7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:00.621157 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0b05e958-a9fd-4451-b311-83cc07d17eb7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:00.621673 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0b05e958-a9fd-4451-b311-83cc07d17eb7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:00.622413 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0b05e958-a9fd-4451-b311-83cc07d17eb7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:00.622788 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0b05e958-a9fd-4451-b311-83cc07d17eb7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:00.802357 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-0b05e958-a9fd-4451-b311-83cc07d17eb7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:00.812592 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-0b05e958-a9fd-4451-b311-83cc07d17eb7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:00.812592 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-0b05e958-a9fd-4451-b311-83cc07d17eb7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:00.813719 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-0b05e958-a9fd-4451-b311-83cc07d17eb7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1723 microversion: 2.20 time: 0.204409 Feb 03 03:00:00.814098 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 274/578] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:00 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:01.166182 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-169a4e4b-8f98-4ae4-86ac-0d4d14e0ac1a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:01.166680 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-169a4e4b-8f98-4ae4-86ac-0d4d14e0ac1a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:01.173364 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-169a4e4b-8f98-4ae4-86ac-0d4d14e0ac1a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:01.173806 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-169a4e4b-8f98-4ae4-86ac-0d4d14e0ac1a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:01.174574 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-169a4e4b-8f98-4ae4-86ac-0d4d14e0ac1a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:01.175000 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-169a4e4b-8f98-4ae4-86ac-0d4d14e0ac1a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:01.199252 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-169a4e4b-8f98-4ae4-86ac-0d4d14e0ac1a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Going to try to terminate instance {{(pid=116386) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 03 03:00:01.281627 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-169a4e4b-8f98-4ae4-86ac-0d4d14e0ac1a tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "DELETE /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 204 len: 0 microversion: 2.1 time: 0.118777 Feb 03 03:00:01.282329 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 305/579] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Feb 3 03:00:01 2022] DELETE /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 03 03:00:01.290382 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-cfedf5d4-0488-4988-9469-8dc95dbf73ec tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:01.290976 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-cfedf5d4-0488-4988-9469-8dc95dbf73ec tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:01.297444 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-cfedf5d4-0488-4988-9469-8dc95dbf73ec tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:01.297938 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-cfedf5d4-0488-4988-9469-8dc95dbf73ec tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:01.298667 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-cfedf5d4-0488-4988-9469-8dc95dbf73ec tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:01.299059 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-cfedf5d4-0488-4988-9469-8dc95dbf73ec tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:01.444930 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-cfedf5d4-0488-4988-9469-8dc95dbf73ec tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:01.453321 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-cfedf5d4-0488-4988-9469-8dc95dbf73ec tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1505 microversion: 2.1 time: 0.166575 Feb 03 03:00:01.462916 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 275/580] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:00:01 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:00:01.831839 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-b988f8dc-2761-447c-ac2f-b2a637746634 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:01.832540 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-b988f8dc-2761-447c-ac2f-b2a637746634 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:01.838990 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b988f8dc-2761-447c-ac2f-b2a637746634 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:01.839433 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b988f8dc-2761-447c-ac2f-b2a637746634 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:01.840219 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b988f8dc-2761-447c-ac2f-b2a637746634 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:01.840650 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b988f8dc-2761-447c-ac2f-b2a637746634 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:01.974870 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-b988f8dc-2761-447c-ac2f-b2a637746634 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:01.983375 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-b988f8dc-2761-447c-ac2f-b2a637746634 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:01.985436 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-b988f8dc-2761-447c-ac2f-b2a637746634 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:01.986601 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-b988f8dc-2761-447c-ac2f-b2a637746634 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1723 microversion: 2.20 time: 0.158870 Feb 03 03:00:01.987349 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 306/581] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:01 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:02.470485 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-5d49a546-67e1-4c2c-b6e5-506c30a66dab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:02.472264 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-5d49a546-67e1-4c2c-b6e5-506c30a66dab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:02.481986 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5d49a546-67e1-4c2c-b6e5-506c30a66dab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:02.482437 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5d49a546-67e1-4c2c-b6e5-506c30a66dab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:02.483203 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5d49a546-67e1-4c2c-b6e5-506c30a66dab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:02.483632 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5d49a546-67e1-4c2c-b6e5-506c30a66dab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:02.624844 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-5d49a546-67e1-4c2c-b6e5-506c30a66dab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:02.632399 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-5d49a546-67e1-4c2c-b6e5-506c30a66dab tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1505 microversion: 2.1 time: 0.165858 Feb 03 03:00:02.633214 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 276/582] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:00:02 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:00:02.987147 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 03 03:00:02.987384 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: Thu Feb 3 03:00:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 03 03:00:03.005335 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-2058557e-6658-4561-ae80-28a16f2542ea tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:03.005939 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-2058557e-6658-4561-ae80-28a16f2542ea tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:03.013668 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2058557e-6658-4561-ae80-28a16f2542ea tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:03.015045 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2058557e-6658-4561-ae80-28a16f2542ea tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:03.016204 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2058557e-6658-4561-ae80-28a16f2542ea tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:03.016619 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2058557e-6658-4561-ae80-28a16f2542ea tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:03.162370 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-2058557e-6658-4561-ae80-28a16f2542ea tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:03.170421 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-2058557e-6658-4561-ae80-28a16f2542ea tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:03.171926 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-2058557e-6658-4561-ae80-28a16f2542ea tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:03.173099 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-2058557e-6658-4561-ae80-28a16f2542ea tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1723 microversion: 2.20 time: 0.171798 Feb 03 03:00:03.174037 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 307/583] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:03 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:03.649845 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-64ca0ff2-01a2-4be5-bbf0-b5f500a86f01 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:03.650424 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-64ca0ff2-01a2-4be5-bbf0-b5f500a86f01 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:03.658778 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-64ca0ff2-01a2-4be5-bbf0-b5f500a86f01 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:03.659281 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-64ca0ff2-01a2-4be5-bbf0-b5f500a86f01 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:03.660107 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-64ca0ff2-01a2-4be5-bbf0-b5f500a86f01 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:03.660566 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-64ca0ff2-01a2-4be5-bbf0-b5f500a86f01 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:03.797568 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-64ca0ff2-01a2-4be5-bbf0-b5f500a86f01 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:03.805717 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-64ca0ff2-01a2-4be5-bbf0-b5f500a86f01 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 200 len: 1505 microversion: 2.1 time: 0.160062 Feb 03 03:00:03.806277 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 277/584] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:00:03 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:00:04.190853 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-99f3f857-51d6-4c1e-b91b-cc6b952ad80f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:04.192098 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-99f3f857-51d6-4c1e-b91b-cc6b952ad80f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:04.198576 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-99f3f857-51d6-4c1e-b91b-cc6b952ad80f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:04.199205 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-99f3f857-51d6-4c1e-b91b-cc6b952ad80f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:04.200215 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-99f3f857-51d6-4c1e-b91b-cc6b952ad80f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:04.200877 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-99f3f857-51d6-4c1e-b91b-cc6b952ad80f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:04.279705 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-da24b174-a7a9-4f08-965b-5a4a3eff9e12 req-b703aa83-a757-4bab-9f89-c9c7d189ceec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2abf9364-36a9-416e-831f-00f7508465bd", "name": "network-vif-deleted", "tag": "56bc6508-b90c-4a56-92a7-ede9dab41a4f"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:00:04.281864 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:00:04.281864 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:00:04.320594 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-da24b174-a7a9-4f08-965b-5a4a3eff9e12 req-b703aa83-a757-4bab-9f89-c9c7d189ceec service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:04.321063 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-da24b174-a7a9-4f08-965b-5a4a3eff9e12 req-b703aa83-a757-4bab-9f89-c9c7d189ceec service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:04.332968 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-da24b174-a7a9-4f08-965b-5a4a3eff9e12 req-b703aa83-a757-4bab-9f89-c9c7d189ceec service nova] Creating event network-vif-deleted:56bc6508-b90c-4a56-92a7-ede9dab41a4f for instance 2abf9364-36a9-416e-831f-00f7508465bd on hv-cinder-82758 Feb 03 03:00:04.338821 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-da24b174-a7a9-4f08-965b-5a4a3eff9e12 req-b703aa83-a757-4bab-9f89-c9c7d189ceec service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063249 Feb 03 03:00:04.340296 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 278/585] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:00:04.381544 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-99f3f857-51d6-4c1e-b91b-cc6b952ad80f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:04.392600 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-99f3f857-51d6-4c1e-b91b-cc6b952ad80f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:04.395232 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-99f3f857-51d6-4c1e-b91b-cc6b952ad80f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:04.397563 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-99f3f857-51d6-4c1e-b91b-cc6b952ad80f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1723 microversion: 2.20 time: 0.209863 Feb 03 03:00:04.398559 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 308/586] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:04 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:04.831891 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-ca99b1af-b397-4957-bddf-30495eb89a7c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:04.831891 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-ca99b1af-b397-4957-bddf-30495eb89a7c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 2abf9364-36a9-416e-831f-00f7508465bd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:04.831891 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ca99b1af-b397-4957-bddf-30495eb89a7c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:04.831891 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ca99b1af-b397-4957-bddf-30495eb89a7c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:04.832568 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ca99b1af-b397-4957-bddf-30495eb89a7c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:04.832568 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ca99b1af-b397-4957-bddf-30495eb89a7c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:04.847971 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.wsgi [None req-ca99b1af-b397-4957-bddf-30495eb89a7c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] HTTP exception thrown: Instance 2abf9364-36a9-416e-831f-00f7508465bd could not be found. Feb 03 03:00:04.848555 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-ca99b1af-b397-4957-bddf-30495eb89a7c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Returning 404 to user: Instance 2abf9364-36a9-416e-831f-00f7508465bd could not be found. {{(pid=116385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 03:00:04.849473 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-ca99b1af-b397-4957-bddf-30495eb89a7c tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd" status: 404 len: 111 microversion: 2.1 time: 0.031130 Feb 03 03:00:04.850016 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 279/587] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:00:04 2022] GET /compute/v2.1/servers/2abf9364-36a9-416e-831f-00f7508465bd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 03:00:04.860288 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-3ddb660a-a930-49a7-84ae-bba8d6cb36fb tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:04.860979 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-3ddb660a-a930-49a7-84ae-bba8d6cb36fb tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:04.868397 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3ddb660a-a930-49a7-84ae-bba8d6cb36fb tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:04.869032 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3ddb660a-a930-49a7-84ae-bba8d6cb36fb tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:04.870122 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3ddb660a-a930-49a7-84ae-bba8d6cb36fb tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:04.870871 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3ddb660a-a930-49a7-84ae-bba8d6cb36fb tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:04.897435 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-3ddb660a-a930-49a7-84ae-bba8d6cb36fb tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Going to try to terminate instance {{(pid=116386) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 03 03:00:04.976081 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-3ddb660a-a930-49a7-84ae-bba8d6cb36fb tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "DELETE /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 204 len: 0 microversion: 2.1 time: 0.120333 Feb 03 03:00:04.976599 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 309/588] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Feb 3 03:00:04 2022] DELETE /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 03 03:00:04.984861 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-fbed8d1d-2264-4b26-857f-23ecb2119457 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:04.985829 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-fbed8d1d-2264-4b26-857f-23ecb2119457 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:04.991777 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fbed8d1d-2264-4b26-857f-23ecb2119457 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:04.992215 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fbed8d1d-2264-4b26-857f-23ecb2119457 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:04.993055 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fbed8d1d-2264-4b26-857f-23ecb2119457 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:04.993479 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fbed8d1d-2264-4b26-857f-23ecb2119457 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:05.131063 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-fbed8d1d-2264-4b26-857f-23ecb2119457 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:05.139456 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-fbed8d1d-2264-4b26-857f-23ecb2119457 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1519 microversion: 2.1 time: 0.158449 Feb 03 03:00:05.140025 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 280/589] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:00:04 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:00:05.421256 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-84baff55-475a-49a0-b974-8a12ff78dc16 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:05.422386 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-84baff55-475a-49a0-b974-8a12ff78dc16 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:05.429939 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-84baff55-475a-49a0-b974-8a12ff78dc16 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:05.430375 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-84baff55-475a-49a0-b974-8a12ff78dc16 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:05.431147 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-84baff55-475a-49a0-b974-8a12ff78dc16 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:05.431570 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-84baff55-475a-49a0-b974-8a12ff78dc16 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:05.576385 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-84baff55-475a-49a0-b974-8a12ff78dc16 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:05.588565 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-84baff55-475a-49a0-b974-8a12ff78dc16 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:05.590983 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-84baff55-475a-49a0-b974-8a12ff78dc16 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:05.592866 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-84baff55-475a-49a0-b974-8a12ff78dc16 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1723 microversion: 2.20 time: 0.178112 Feb 03 03:00:05.593707 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 310/590] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:05 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:06.157772 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-9d4d4fc9-355b-4a1e-b179-77fed73e9824 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:06.158294 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-9d4d4fc9-355b-4a1e-b179-77fed73e9824 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:06.164881 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9d4d4fc9-355b-4a1e-b179-77fed73e9824 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:06.165317 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9d4d4fc9-355b-4a1e-b179-77fed73e9824 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:06.166065 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9d4d4fc9-355b-4a1e-b179-77fed73e9824 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:06.166478 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9d4d4fc9-355b-4a1e-b179-77fed73e9824 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:06.300877 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-9d4d4fc9-355b-4a1e-b179-77fed73e9824 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:06.308276 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-9d4d4fc9-355b-4a1e-b179-77fed73e9824 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1519 microversion: 2.1 time: 0.154275 Feb 03 03:00:06.308858 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 281/591] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:00:06 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:00:06.612627 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-84814f59-1732-4744-a213-eeb229e99d41 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:06.613397 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-84814f59-1732-4744-a213-eeb229e99d41 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:06.619946 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-84814f59-1732-4744-a213-eeb229e99d41 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:06.620390 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-84814f59-1732-4744-a213-eeb229e99d41 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:06.621196 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-84814f59-1732-4744-a213-eeb229e99d41 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:06.621628 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-84814f59-1732-4744-a213-eeb229e99d41 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:06.769442 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-84814f59-1732-4744-a213-eeb229e99d41 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:06.777932 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-84814f59-1732-4744-a213-eeb229e99d41 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:06.779410 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-84814f59-1732-4744-a213-eeb229e99d41 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:06.780555 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-84814f59-1732-4744-a213-eeb229e99d41 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1744 microversion: 2.20 time: 0.171759 Feb 03 03:00:06.781113 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 311/592] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:06 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:07.327255 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-3780f217-9947-4e90-8b74-4fd327bdb56d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:07.327950 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-3780f217-9947-4e90-8b74-4fd327bdb56d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:07.334958 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3780f217-9947-4e90-8b74-4fd327bdb56d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:07.335360 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3780f217-9947-4e90-8b74-4fd327bdb56d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:07.336134 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3780f217-9947-4e90-8b74-4fd327bdb56d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:07.336562 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3780f217-9947-4e90-8b74-4fd327bdb56d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:07.474805 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-3780f217-9947-4e90-8b74-4fd327bdb56d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:07.482699 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-3780f217-9947-4e90-8b74-4fd327bdb56d tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1519 microversion: 2.1 time: 0.159142 Feb 03 03:00:07.483271 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 282/593] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:00:07 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:00:07.803220 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-7e1e674e-f1e1-49b4-a168-9d8cc2f726ea tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:07.804197 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-7e1e674e-f1e1-49b4-a168-9d8cc2f726ea tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:07.814732 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7e1e674e-f1e1-49b4-a168-9d8cc2f726ea tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:07.815466 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7e1e674e-f1e1-49b4-a168-9d8cc2f726ea tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:07.816854 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7e1e674e-f1e1-49b4-a168-9d8cc2f726ea tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:07.817311 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7e1e674e-f1e1-49b4-a168-9d8cc2f726ea tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:07.955490 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-7e1e674e-f1e1-49b4-a168-9d8cc2f726ea tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:07.964000 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-7e1e674e-f1e1-49b4-a168-9d8cc2f726ea tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:07.965507 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-7e1e674e-f1e1-49b4-a168-9d8cc2f726ea tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:07.966656 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-7e1e674e-f1e1-49b4-a168-9d8cc2f726ea tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1744 microversion: 2.20 time: 0.169873 Feb 03 03:00:07.967210 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 312/594] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:07 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:08.287825 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-d54f3207-3e7e-43a8-986b-a32c7c1bf5fb tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:08.288331 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-d54f3207-3e7e-43a8-986b-a32c7c1bf5fb tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:08.294651 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d54f3207-3e7e-43a8-986b-a32c7c1bf5fb tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:08.295096 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d54f3207-3e7e-43a8-986b-a32c7c1bf5fb tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:08.295857 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d54f3207-3e7e-43a8-986b-a32c7c1bf5fb tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:08.296281 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d54f3207-3e7e-43a8-986b-a32c7c1bf5fb tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:08.372052 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.objects.instance [None req-d54f3207-3e7e-43a8-986b-a32c7c1bf5fb tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lazy-loading 'services' on Instance uuid 9a00957e-c905-4466-8a03-befe71ab1e1c {{(pid=116385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 03 03:00:08.441101 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-d54f3207-3e7e-43a8-986b-a32c7c1bf5fb tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "DELETE /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c/os-volume_attachments/4af57d0e-9004-4664-b9e1-491119ef4414" status: 202 len: 0 microversion: 2.1 time: 0.156872 Feb 03 03:00:08.441735 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 283/595] 10.222.0.31 () {58 vars in 1415 bytes} [Thu Feb 3 03:00:08 2022] DELETE /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c/os-volume_attachments/4af57d0e-9004-4664-b9e1-491119ef4414 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 03 03:00:08.499712 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-8d894f14-a5e8-4701-99e7-de2a2a0409ba tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:08.500325 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-8d894f14-a5e8-4701-99e7-de2a2a0409ba tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:08.507789 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8d894f14-a5e8-4701-99e7-de2a2a0409ba tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:08.508234 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8d894f14-a5e8-4701-99e7-de2a2a0409ba tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:08.509148 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8d894f14-a5e8-4701-99e7-de2a2a0409ba tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:08.509583 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8d894f14-a5e8-4701-99e7-de2a2a0409ba tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:08.647450 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-8d894f14-a5e8-4701-99e7-de2a2a0409ba tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:08.657514 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-8d894f14-a5e8-4701-99e7-de2a2a0409ba tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1519 microversion: 2.1 time: 0.158983 Feb 03 03:00:08.657514 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 313/596] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:00:08 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:00:08.985619 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-67df5aaa-4aa2-458d-bdb6-1cc23e173479 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:08.986582 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-67df5aaa-4aa2-458d-bdb6-1cc23e173479 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:08.992899 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-67df5aaa-4aa2-458d-bdb6-1cc23e173479 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:08.993483 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-67df5aaa-4aa2-458d-bdb6-1cc23e173479 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:08.994268 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-67df5aaa-4aa2-458d-bdb6-1cc23e173479 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:08.994694 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-67df5aaa-4aa2-458d-bdb6-1cc23e173479 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:09.143536 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-67df5aaa-4aa2-458d-bdb6-1cc23e173479 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:09.154024 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-67df5aaa-4aa2-458d-bdb6-1cc23e173479 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:09.155662 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-67df5aaa-4aa2-458d-bdb6-1cc23e173479 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:09.157544 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-67df5aaa-4aa2-458d-bdb6-1cc23e173479 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1744 microversion: 2.20 time: 0.175347 Feb 03 03:00:09.157641 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 284/597] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:08 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:09.553529 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-9e6cf4cc-c13f-4898-8a41-d39a9f9e24ac tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:00:09.560754 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-9e6cf4cc-c13f-4898-8a41-d39a9f9e24ac tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:09.561375 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-9e6cf4cc-c13f-4898-8a41-d39a9f9e24ac tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:09.585023 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-9e6cf4cc-c13f-4898-8a41-d39a9f9e24ac tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Going to try to stop instance {{(pid=116386) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Feb 03 03:00:09.638747 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-9e6cf4cc-c13f-4898-8a41-d39a9f9e24ac tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "POST /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c/action" status: 202 len: 0 microversion: 2.1 time: 0.088725 Feb 03 03:00:09.639402 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 314/598] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Feb 3 03:00:09 2022] POST /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 03 03:00:09.648322 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-9fa5fe32-5cd0-4f7e-8fcd-255627d0d508 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:09.650301 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-9fa5fe32-5cd0-4f7e-8fcd-255627d0d508 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:09.659022 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9fa5fe32-5cd0-4f7e-8fcd-255627d0d508 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:09.660172 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9fa5fe32-5cd0-4f7e-8fcd-255627d0d508 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:09.661549 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9fa5fe32-5cd0-4f7e-8fcd-255627d0d508 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:09.662322 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9fa5fe32-5cd0-4f7e-8fcd-255627d0d508 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:09.672371 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-99b79913-0310-451d-8e7a-3efe4c8339ac tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:09.673083 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-99b79913-0310-451d-8e7a-3efe4c8339ac tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:09.679269 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-99b79913-0310-451d-8e7a-3efe4c8339ac tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:09.679907 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-99b79913-0310-451d-8e7a-3efe4c8339ac tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:09.680709 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-99b79913-0310-451d-8e7a-3efe4c8339ac tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:09.681141 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-99b79913-0310-451d-8e7a-3efe4c8339ac tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:09.933083 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-9fa5fe32-5cd0-4f7e-8fcd-255627d0d508 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:09.937303 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-99b79913-0310-451d-8e7a-3efe4c8339ac tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:09.941290 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-9fa5fe32-5cd0-4f7e-8fcd-255627d0d508 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1679 microversion: 2.1 time: 0.296712 Feb 03 03:00:09.942023 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 285/599] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:00:09 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1679 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:00:09.954653 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-99b79913-0310-451d-8e7a-3efe4c8339ac tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1519 microversion: 2.1 time: 0.286762 Feb 03 03:00:09.955492 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 315/600] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:00:09 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1519 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 03:00:10.178663 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-7d73b2fb-64ff-407b-b857-04c46484cf38 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:10.179409 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-7d73b2fb-64ff-407b-b857-04c46484cf38 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:10.193469 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7d73b2fb-64ff-407b-b857-04c46484cf38 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:10.193912 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7d73b2fb-64ff-407b-b857-04c46484cf38 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:10.194703 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7d73b2fb-64ff-407b-b857-04c46484cf38 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:10.195131 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7d73b2fb-64ff-407b-b857-04c46484cf38 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:10.218011 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-8a7cb63f-70f2-4a14-be2c-3b63ea0de117 req-dae78d14-1370-493a-b8b3-c1c64c2cc97a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0708ed4-206d-484e-a2b4-dfb7733d415b", "name": "network-vif-plugged", "status": "completed", "tag": "27c8015c-4643-475a-85ae-a540d30129eb"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:00:10.219615 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:00:10.219615 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 03:00:10.232514 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-8a7cb63f-70f2-4a14-be2c-3b63ea0de117 req-dae78d14-1370-493a-b8b3-c1c64c2cc97a service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:10.232990 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-8a7cb63f-70f2-4a14-be2c-3b63ea0de117 req-dae78d14-1370-493a-b8b3-c1c64c2cc97a service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:10.249016 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-8a7cb63f-70f2-4a14-be2c-3b63ea0de117 req-dae78d14-1370-493a-b8b3-c1c64c2cc97a service nova] Creating event network-vif-plugged:27c8015c-4643-475a-85ae-a540d30129eb for instance e0708ed4-206d-484e-a2b4-dfb7733d415b on hv-cinder-82758 Feb 03 03:00:10.254540 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-8a7cb63f-70f2-4a14-be2c-3b63ea0de117 req-dae78d14-1370-493a-b8b3-c1c64c2cc97a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040126 Feb 03 03:00:10.276900 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 316/601] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 03 03:00:10.371723 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-7d73b2fb-64ff-407b-b857-04c46484cf38 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:10.386299 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-7d73b2fb-64ff-407b-b857-04c46484cf38 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:10.389493 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-7d73b2fb-64ff-407b-b857-04c46484cf38 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:10.391284 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-7d73b2fb-64ff-407b-b857-04c46484cf38 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1739 microversion: 2.20 time: 0.216562 Feb 03 03:00:10.402309 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 286/602] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:10 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:10.961088 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-b67a37db-2bfb-4c8f-a77b-375762e6e58b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:10.962460 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-b67a37db-2bfb-4c8f-a77b-375762e6e58b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:10.971142 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-a493cf12-ba77-4b92-81fc-bb400995abef tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:10.972507 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-a493cf12-ba77-4b92-81fc-bb400995abef tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:10.985613 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b67a37db-2bfb-4c8f-a77b-375762e6e58b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:10.986005 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b67a37db-2bfb-4c8f-a77b-375762e6e58b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:10.986800 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b67a37db-2bfb-4c8f-a77b-375762e6e58b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:10.987233 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b67a37db-2bfb-4c8f-a77b-375762e6e58b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:10.990004 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a493cf12-ba77-4b92-81fc-bb400995abef tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:10.990846 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a493cf12-ba77-4b92-81fc-bb400995abef tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:10.992035 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a493cf12-ba77-4b92-81fc-bb400995abef tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:10.992952 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a493cf12-ba77-4b92-81fc-bb400995abef tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:11.302753 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-a493cf12-ba77-4b92-81fc-bb400995abef tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:11.312244 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-a493cf12-ba77-4b92-81fc-bb400995abef tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1519 microversion: 2.1 time: 0.344505 Feb 03 03:00:11.313510 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 287/603] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:00:10 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1519 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:00:11.325959 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-b67a37db-2bfb-4c8f-a77b-375762e6e58b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:11.342978 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-b67a37db-2bfb-4c8f-a77b-375762e6e58b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1679 microversion: 2.1 time: 0.387217 Feb 03 03:00:11.344060 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 317/604] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:00:10 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1679 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:00:11.410603 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-30a6c823-d1cd-4f33-afd7-e22c058e435c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:11.411262 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-30a6c823-d1cd-4f33-afd7-e22c058e435c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:11.422068 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-30a6c823-d1cd-4f33-afd7-e22c058e435c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:11.425399 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-30a6c823-d1cd-4f33-afd7-e22c058e435c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:11.430012 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-30a6c823-d1cd-4f33-afd7-e22c058e435c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:11.430458 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-30a6c823-d1cd-4f33-afd7-e22c058e435c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:11.711462 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-30a6c823-d1cd-4f33-afd7-e22c058e435c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:11.719240 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-30a6c823-d1cd-4f33-afd7-e22c058e435c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:11.720758 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-30a6c823-d1cd-4f33-afd7-e22c058e435c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:11.722534 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-30a6c823-d1cd-4f33-afd7-e22c058e435c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1739 microversion: 2.20 time: 0.316338 Feb 03 03:00:11.735356 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 288/605] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:11 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1739 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:12.016560 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-960774c8-761a-44c0-9656-dcabeed4297f req-86a4a667-38ea-4cbb-b510-170c5c312b6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e", "name": "network-vif-deleted", "tag": "514f132e-1831-4333-8bbe-abcdacde0949"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:00:12.018105 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:00:12.018105 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 03:00:12.033017 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-960774c8-761a-44c0-9656-dcabeed4297f req-86a4a667-38ea-4cbb-b510-170c5c312b6a service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:12.033685 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-960774c8-761a-44c0-9656-dcabeed4297f req-86a4a667-38ea-4cbb-b510-170c5c312b6a service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:12.048757 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-960774c8-761a-44c0-9656-dcabeed4297f req-86a4a667-38ea-4cbb-b510-170c5c312b6a service nova] Creating event network-vif-deleted:514f132e-1831-4333-8bbe-abcdacde0949 for instance 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e on hv-cinder-82758 Feb 03 03:00:12.054958 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-960774c8-761a-44c0-9656-dcabeed4297f req-86a4a667-38ea-4cbb-b510-170c5c312b6a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041988 Feb 03 03:00:12.058964 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 318/606] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:00:12.329441 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-45add797-02d2-42b9-8fd9-3362f02cf077 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:12.330805 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-45add797-02d2-42b9-8fd9-3362f02cf077 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:12.339852 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-45add797-02d2-42b9-8fd9-3362f02cf077 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:12.340833 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-45add797-02d2-42b9-8fd9-3362f02cf077 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:12.342086 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-45add797-02d2-42b9-8fd9-3362f02cf077 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:12.342522 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-45add797-02d2-42b9-8fd9-3362f02cf077 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:12.367662 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-65b20408-202c-4f3e-8625-e78455873f2b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:12.368781 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-65b20408-202c-4f3e-8625-e78455873f2b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:12.382021 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-65b20408-202c-4f3e-8625-e78455873f2b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:12.382606 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-65b20408-202c-4f3e-8625-e78455873f2b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:12.385190 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-65b20408-202c-4f3e-8625-e78455873f2b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:12.385740 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-65b20408-202c-4f3e-8625-e78455873f2b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:12.391960 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-45add797-02d2-42b9-8fd9-3362f02cf077 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:12.392878 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-45add797-02d2-42b9-8fd9-3362f02cf077 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:12.393752 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.objects.instance [None req-45add797-02d2-42b9-8fd9-3362f02cf077 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lazy-loading 'fault' on Instance uuid 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e {{(pid=116385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 03 03:00:12.455674 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-45add797-02d2-42b9-8fd9-3362f02cf077 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f755cdacf8054a9e916ec75f1dedc105', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cdfe1c1946840c19d3d559fb81e34b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:12.464364 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-45add797-02d2-42b9-8fd9-3362f02cf077 tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 200 len: 1311 microversion: 2.1 time: 0.138658 Feb 03 03:00:12.476462 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 289/607] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:00:12 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 1311 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:00:12.658779 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-65b20408-202c-4f3e-8625-e78455873f2b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:12.676495 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-65b20408-202c-4f3e-8625-e78455873f2b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1679 microversion: 2.1 time: 0.318136 Feb 03 03:00:12.685551 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 319/608] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:00:12 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1679 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:00:12.741297 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-4702cb75-950c-467b-874a-2310c001cdb8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:12.742166 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-4702cb75-950c-467b-874a-2310c001cdb8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:12.748795 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4702cb75-950c-467b-874a-2310c001cdb8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:12.749229 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4702cb75-950c-467b-874a-2310c001cdb8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:12.750189 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4702cb75-950c-467b-874a-2310c001cdb8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:12.750766 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4702cb75-950c-467b-874a-2310c001cdb8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:12.926409 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-4702cb75-950c-467b-874a-2310c001cdb8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:12.935068 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-4702cb75-950c-467b-874a-2310c001cdb8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:12.936588 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-4702cb75-950c-467b-874a-2310c001cdb8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:12.937835 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-4702cb75-950c-467b-874a-2310c001cdb8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1739 microversion: 2.20 time: 0.200768 Feb 03 03:00:12.938468 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 290/609] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:12 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:13.483588 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-db7db72c-2e82-42b8-8832-cdd17083731e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:13.484183 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-db7db72c-2e82-42b8-8832-cdd17083731e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] [instance: 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:13.490786 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-db7db72c-2e82-42b8-8832-cdd17083731e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:13.491240 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-db7db72c-2e82-42b8-8832-cdd17083731e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:13.492023 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-db7db72c-2e82-42b8-8832-cdd17083731e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:13.492459 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-db7db72c-2e82-42b8-8832-cdd17083731e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:13.507001 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.wsgi [None req-db7db72c-2e82-42b8-8832-cdd17083731e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] HTTP exception thrown: Instance 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e could not be found. Feb 03 03:00:13.507884 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-db7db72c-2e82-42b8-8832-cdd17083731e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] Returning 404 to user: Instance 01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e could not be found. {{(pid=116386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 03:00:13.508743 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-db7db72c-2e82-42b8-8832-cdd17083731e tempest-ServerRescueNegativeTestJSON-1472809200 tempest-ServerRescueNegativeTestJSON-1472809200-project] 10.222.0.31 "GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e" status: 404 len: 111 microversion: 2.1 time: 0.029028 Feb 03 03:00:13.509296 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 320/610] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:00:13 2022] GET /compute/v2.1/servers/01fd51c9-e591-4272-8a4b-4ff1ae8f8e1e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 03:00:13.697358 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-4c520968-ca49-4eb3-9063-bf7c93d52a3d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:13.698064 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-4c520968-ca49-4eb3-9063-bf7c93d52a3d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:13.710054 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4c520968-ca49-4eb3-9063-bf7c93d52a3d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:13.713572 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4c520968-ca49-4eb3-9063-bf7c93d52a3d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:13.715078 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4c520968-ca49-4eb3-9063-bf7c93d52a3d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:13.723903 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4c520968-ca49-4eb3-9063-bf7c93d52a3d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:13.957333 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-70bf1f14-7298-4253-b926-af614f9ffc45 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:13.958420 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-70bf1f14-7298-4253-b926-af614f9ffc45 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:13.963532 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-4c520968-ca49-4eb3-9063-bf7c93d52a3d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:13.969774 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-70bf1f14-7298-4253-b926-af614f9ffc45 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:13.982508 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-4c520968-ca49-4eb3-9063-bf7c93d52a3d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1679 microversion: 2.1 time: 0.290817 Feb 03 03:00:13.983981 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 291/611] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:00:13 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1679 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:00:13.986181 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-70bf1f14-7298-4253-b926-af614f9ffc45 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:13.987321 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-70bf1f14-7298-4253-b926-af614f9ffc45 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:13.988917 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-70bf1f14-7298-4253-b926-af614f9ffc45 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:14.200064 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-70bf1f14-7298-4253-b926-af614f9ffc45 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:14.209619 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-70bf1f14-7298-4253-b926-af614f9ffc45 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:14.211520 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-70bf1f14-7298-4253-b926-af614f9ffc45 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:14.213189 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-70bf1f14-7298-4253-b926-af614f9ffc45 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1739 microversion: 2.20 time: 0.259465 Feb 03 03:00:14.230132 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 321/612] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:13 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1739 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:15.006775 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-1e3ace9e-82b3-469c-a230-966ee202f616 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:15.008547 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-1e3ace9e-82b3-469c-a230-966ee202f616 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:15.019826 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1e3ace9e-82b3-469c-a230-966ee202f616 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:15.021290 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1e3ace9e-82b3-469c-a230-966ee202f616 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:15.022295 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1e3ace9e-82b3-469c-a230-966ee202f616 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:15.022838 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1e3ace9e-82b3-469c-a230-966ee202f616 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:15.216611 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-1e3ace9e-82b3-469c-a230-966ee202f616 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:15.231634 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-1e3ace9e-82b3-469c-a230-966ee202f616 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1679 microversion: 2.1 time: 0.228936 Feb 03 03:00:15.231790 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-048cfaf5-58e3-4275-b89e-9e93c1b43a38 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:15.232461 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-048cfaf5-58e3-4275-b89e-9e93c1b43a38 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:15.241987 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-048cfaf5-58e3-4275-b89e-9e93c1b43a38 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:15.243006 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 292/613] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:00:15 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1679 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:00:15.243437 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-048cfaf5-58e3-4275-b89e-9e93c1b43a38 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:15.244320 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-048cfaf5-58e3-4275-b89e-9e93c1b43a38 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:15.252305 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-048cfaf5-58e3-4275-b89e-9e93c1b43a38 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:15.542476 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-048cfaf5-58e3-4275-b89e-9e93c1b43a38 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:15.551640 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-048cfaf5-58e3-4275-b89e-9e93c1b43a38 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:15.553600 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-048cfaf5-58e3-4275-b89e-9e93c1b43a38 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:15.555101 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-048cfaf5-58e3-4275-b89e-9e93c1b43a38 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1739 microversion: 2.20 time: 0.327216 Feb 03 03:00:15.556588 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 322/614] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:15 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1739 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 03 03:00:16.248103 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-43c7f4d0-b454-456c-9771-2cc44c50ea5b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:16.249872 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-43c7f4d0-b454-456c-9771-2cc44c50ea5b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:16.262942 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-43c7f4d0-b454-456c-9771-2cc44c50ea5b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:16.268894 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-43c7f4d0-b454-456c-9771-2cc44c50ea5b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:16.270022 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-43c7f4d0-b454-456c-9771-2cc44c50ea5b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:16.270672 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-43c7f4d0-b454-456c-9771-2cc44c50ea5b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:16.487289 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-43c7f4d0-b454-456c-9771-2cc44c50ea5b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:16.497708 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-43c7f4d0-b454-456c-9771-2cc44c50ea5b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1679 microversion: 2.1 time: 0.253037 Feb 03 03:00:16.508513 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 293/615] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:00:16 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1679 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:00:16.585606 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-6c37f8ff-1623-44e4-b295-2d88a1ed6011 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:16.587479 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-6c37f8ff-1623-44e4-b295-2d88a1ed6011 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:16.604189 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6c37f8ff-1623-44e4-b295-2d88a1ed6011 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:16.605818 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6c37f8ff-1623-44e4-b295-2d88a1ed6011 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:16.606804 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6c37f8ff-1623-44e4-b295-2d88a1ed6011 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:16.607548 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6c37f8ff-1623-44e4-b295-2d88a1ed6011 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:16.790608 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-6c37f8ff-1623-44e4-b295-2d88a1ed6011 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:16.800091 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-6c37f8ff-1623-44e4-b295-2d88a1ed6011 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:16.802979 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-6c37f8ff-1623-44e4-b295-2d88a1ed6011 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:16.805231 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-6c37f8ff-1623-44e4-b295-2d88a1ed6011 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1739 microversion: 2.20 time: 0.232837 Feb 03 03:00:16.806290 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 323/616] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:16 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1739 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 03 03:00:17.517352 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-f5edd4c4-355e-40f0-8baf-253c030f1c06 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:17.518148 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-f5edd4c4-355e-40f0-8baf-253c030f1c06 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:17.528043 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f5edd4c4-355e-40f0-8baf-253c030f1c06 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:17.530401 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f5edd4c4-355e-40f0-8baf-253c030f1c06 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:17.531471 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f5edd4c4-355e-40f0-8baf-253c030f1c06 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:17.533684 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f5edd4c4-355e-40f0-8baf-253c030f1c06 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:17.776970 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-f5edd4c4-355e-40f0-8baf-253c030f1c06 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:17.787833 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-f5edd4c4-355e-40f0-8baf-253c030f1c06 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1679 microversion: 2.1 time: 0.275385 Feb 03 03:00:17.789312 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 294/617] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:00:17 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1679 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:00:17.824186 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-8b5f6732-9dda-442b-80ce-442494a890ef tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:17.825611 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-8b5f6732-9dda-442b-80ce-442494a890ef tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:17.834612 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8b5f6732-9dda-442b-80ce-442494a890ef tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:17.835462 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8b5f6732-9dda-442b-80ce-442494a890ef tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:17.837750 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8b5f6732-9dda-442b-80ce-442494a890ef tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:17.838533 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8b5f6732-9dda-442b-80ce-442494a890ef tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:18.114015 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-8b5f6732-9dda-442b-80ce-442494a890ef tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:18.125186 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-8b5f6732-9dda-442b-80ce-442494a890ef tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:18.129437 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-8b5f6732-9dda-442b-80ce-442494a890ef tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:18.131884 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-8b5f6732-9dda-442b-80ce-442494a890ef tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1739 microversion: 2.20 time: 0.312198 Feb 03 03:00:18.145108 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 324/618] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:17 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1739 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:18.807122 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-3b460c36-059e-4acb-9716-2a4c4303e46f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:18.808616 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-3b460c36-059e-4acb-9716-2a4c4303e46f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:18.822421 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3b460c36-059e-4acb-9716-2a4c4303e46f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:18.823124 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3b460c36-059e-4acb-9716-2a4c4303e46f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:18.826452 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3b460c36-059e-4acb-9716-2a4c4303e46f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:18.827087 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3b460c36-059e-4acb-9716-2a4c4303e46f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:19.038140 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-3b460c36-059e-4acb-9716-2a4c4303e46f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:19.047690 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-3b460c36-059e-4acb-9716-2a4c4303e46f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1679 microversion: 2.1 time: 0.245009 Feb 03 03:00:19.058827 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 295/619] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:00:18 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1679 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:00:19.162201 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-2938a5ff-ed44-49a2-a166-80a3e43ce779 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:19.162790 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-2938a5ff-ed44-49a2-a166-80a3e43ce779 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:19.178474 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2938a5ff-ed44-49a2-a166-80a3e43ce779 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:19.179104 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2938a5ff-ed44-49a2-a166-80a3e43ce779 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:19.179924 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2938a5ff-ed44-49a2-a166-80a3e43ce779 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:19.182992 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2938a5ff-ed44-49a2-a166-80a3e43ce779 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:19.366380 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-2938a5ff-ed44-49a2-a166-80a3e43ce779 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:19.377615 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-2938a5ff-ed44-49a2-a166-80a3e43ce779 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:19.380779 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-2938a5ff-ed44-49a2-a166-80a3e43ce779 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:19.382498 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-2938a5ff-ed44-49a2-a166-80a3e43ce779 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1739 microversion: 2.20 time: 0.224051 Feb 03 03:00:19.383767 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 325/620] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:19 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1739 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:20.065822 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-5e916b85-0113-4e39-94dd-a4611f976adf tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:20.066470 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-5e916b85-0113-4e39-94dd-a4611f976adf tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:20.079023 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5e916b85-0113-4e39-94dd-a4611f976adf tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:20.084577 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5e916b85-0113-4e39-94dd-a4611f976adf tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:20.086658 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5e916b85-0113-4e39-94dd-a4611f976adf tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:20.087107 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5e916b85-0113-4e39-94dd-a4611f976adf tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:20.329185 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-5e916b85-0113-4e39-94dd-a4611f976adf tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:20.341768 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-5e916b85-0113-4e39-94dd-a4611f976adf tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1656 microversion: 2.1 time: 0.279421 Feb 03 03:00:20.344855 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 296/621] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:00:20 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1656 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:00:20.360007 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-6ce78aef-d105-4cdb-8214-8ae23f6eb571 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:00:20.368302 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6ce78aef-d105-4cdb-8214-8ae23f6eb571 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:20.369043 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6ce78aef-d105-4cdb-8214-8ae23f6eb571 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:20.406134 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-dba2d6e8-0da5-4fa2-8a14-a3196066a8c3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:20.407059 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-dba2d6e8-0da5-4fa2-8a14-a3196066a8c3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:20.418033 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-6ce78aef-d105-4cdb-8214-8ae23f6eb571 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Going to try to start instance {{(pid=116386) start /opt/stack/nova/nova/compute/api.py:2677}} Feb 03 03:00:20.421246 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-dba2d6e8-0da5-4fa2-8a14-a3196066a8c3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:20.425203 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-dba2d6e8-0da5-4fa2-8a14-a3196066a8c3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:20.426248 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-dba2d6e8-0da5-4fa2-8a14-a3196066a8c3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:20.428356 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-dba2d6e8-0da5-4fa2-8a14-a3196066a8c3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:20.495013 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-6ce78aef-d105-4cdb-8214-8ae23f6eb571 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "POST /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c/action" status: 202 len: 0 microversion: 2.1 time: 0.139276 Feb 03 03:00:20.496016 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 326/622] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Feb 3 03:00:20 2022] POST /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 03 03:00:20.508769 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-ccc24f2d-41fc-407a-9c4d-0d6a5684f21b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:20.509818 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-ccc24f2d-41fc-407a-9c4d-0d6a5684f21b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:20.516581 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ccc24f2d-41fc-407a-9c4d-0d6a5684f21b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:20.517356 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ccc24f2d-41fc-407a-9c4d-0d6a5684f21b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:20.518553 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ccc24f2d-41fc-407a-9c4d-0d6a5684f21b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:20.519428 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ccc24f2d-41fc-407a-9c4d-0d6a5684f21b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:20.759068 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-dba2d6e8-0da5-4fa2-8a14-a3196066a8c3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:20.774886 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-dba2d6e8-0da5-4fa2-8a14-a3196066a8c3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:20.776428 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-dba2d6e8-0da5-4fa2-8a14-a3196066a8c3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:20.782752 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-dba2d6e8-0da5-4fa2-8a14-a3196066a8c3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1739 microversion: 2.20 time: 0.382000 Feb 03 03:00:20.788913 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 297/623] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:20 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1739 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:20.871270 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-ccc24f2d-41fc-407a-9c4d-0d6a5684f21b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:20.879023 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-ccc24f2d-41fc-407a-9c4d-0d6a5684f21b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1665 microversion: 2.1 time: 0.378968 Feb 03 03:00:20.882501 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 327/624] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:00:20 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1665 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 03:00:21.802336 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-d9f80c12-7c70-4ed1-be1e-524b6c910c8e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:21.802929 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-d9f80c12-7c70-4ed1-be1e-524b6c910c8e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:21.809502 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d9f80c12-7c70-4ed1-be1e-524b6c910c8e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:21.810140 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d9f80c12-7c70-4ed1-be1e-524b6c910c8e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:21.811457 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d9f80c12-7c70-4ed1-be1e-524b6c910c8e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:21.812208 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d9f80c12-7c70-4ed1-be1e-524b6c910c8e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:21.903607 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-a7170fe7-7c29-414c-968e-2ddf09851f89 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:21.904227 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-a7170fe7-7c29-414c-968e-2ddf09851f89 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:21.911768 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a7170fe7-7c29-414c-968e-2ddf09851f89 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:21.912791 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a7170fe7-7c29-414c-968e-2ddf09851f89 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:21.913745 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a7170fe7-7c29-414c-968e-2ddf09851f89 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:21.914337 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a7170fe7-7c29-414c-968e-2ddf09851f89 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:22.069374 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-d9f80c12-7c70-4ed1-be1e-524b6c910c8e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:22.084737 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-d9f80c12-7c70-4ed1-be1e-524b6c910c8e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:22.095802 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-d9f80c12-7c70-4ed1-be1e-524b6c910c8e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:22.097056 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-d9f80c12-7c70-4ed1-be1e-524b6c910c8e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1721 microversion: 2.20 time: 0.299117 Feb 03 03:00:22.097785 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 298/625] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:21 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1721 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:22.127829 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-a7170fe7-7c29-414c-968e-2ddf09851f89 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:22.138675 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-a7170fe7-7c29-414c-968e-2ddf09851f89 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1665 microversion: 2.1 time: 0.238683 Feb 03 03:00:22.139252 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 328/626] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:00:21 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1665 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:00:23.118093 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-e1271609-6526-4bb8-9ec1-c4128a66b738 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:23.118672 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-e1271609-6526-4bb8-9ec1-c4128a66b738 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:23.125085 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e1271609-6526-4bb8-9ec1-c4128a66b738 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:23.125533 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e1271609-6526-4bb8-9ec1-c4128a66b738 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:23.126322 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e1271609-6526-4bb8-9ec1-c4128a66b738 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:23.126811 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e1271609-6526-4bb8-9ec1-c4128a66b738 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:23.155276 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-77a3ffbe-2a44-46e0-9099-db99ccdfead2 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:23.155885 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-77a3ffbe-2a44-46e0-9099-db99ccdfead2 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:23.162578 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-77a3ffbe-2a44-46e0-9099-db99ccdfead2 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:23.163000 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-77a3ffbe-2a44-46e0-9099-db99ccdfead2 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:23.163846 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-77a3ffbe-2a44-46e0-9099-db99ccdfead2 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:23.164235 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-77a3ffbe-2a44-46e0-9099-db99ccdfead2 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:23.322893 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-e1271609-6526-4bb8-9ec1-c4128a66b738 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:23.330951 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-e1271609-6526-4bb8-9ec1-c4128a66b738 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:23.332505 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-e1271609-6526-4bb8-9ec1-c4128a66b738 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:23.334009 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-e1271609-6526-4bb8-9ec1-c4128a66b738 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1721 microversion: 2.20 time: 0.220014 Feb 03 03:00:23.334753 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 299/627] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:23 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:23.359995 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-77a3ffbe-2a44-46e0-9099-db99ccdfead2 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:23.369143 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-77a3ffbe-2a44-46e0-9099-db99ccdfead2 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1669 microversion: 2.1 time: 0.217481 Feb 03 03:00:23.369729 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 329/628] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:00:23 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1669 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:00:24.187964 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-62a9e6c1-f915-42cd-ac97-9a69ea21b9dc req-7fa4e733-be3d-4c8d-8748-5ab668805af5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0708ed4-206d-484e-a2b4-dfb7733d415b", "name": "network-vif-unplugged", "status": "completed", "tag": "27c8015c-4643-475a-85ae-a540d30129eb"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:00:24.189820 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:00:24.189820 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:00:24.197572 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-62a9e6c1-f915-42cd-ac97-9a69ea21b9dc req-7fa4e733-be3d-4c8d-8748-5ab668805af5 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:24.198116 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-62a9e6c1-f915-42cd-ac97-9a69ea21b9dc req-7fa4e733-be3d-4c8d-8748-5ab668805af5 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:24.209557 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.compute.server_external_events [req-62a9e6c1-f915-42cd-ac97-9a69ea21b9dc req-7fa4e733-be3d-4c8d-8748-5ab668805af5 service nova] Unable to find a host for instance e0708ed4-206d-484e-a2b4-dfb7733d415b. Dropping event network-vif-unplugged {{(pid=116385) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 03 03:00:24.210427 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-62a9e6c1-f915-42cd-ac97-9a69ea21b9dc req-7fa4e733-be3d-4c8d-8748-5ab668805af5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030546 Feb 03 03:00:24.211024 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 300/629] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 03 03:00:24.354357 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-e3241dcc-c03c-43d6-8582-18d55dcf9a7b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:24.354949 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-e3241dcc-c03c-43d6-8582-18d55dcf9a7b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:24.361876 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e3241dcc-c03c-43d6-8582-18d55dcf9a7b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:24.362314 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e3241dcc-c03c-43d6-8582-18d55dcf9a7b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:24.363093 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e3241dcc-c03c-43d6-8582-18d55dcf9a7b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:24.363520 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e3241dcc-c03c-43d6-8582-18d55dcf9a7b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:24.507087 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-e3241dcc-c03c-43d6-8582-18d55dcf9a7b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:24.515177 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-e3241dcc-c03c-43d6-8582-18d55dcf9a7b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:24.516658 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-e3241dcc-c03c-43d6-8582-18d55dcf9a7b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:24.517836 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-e3241dcc-c03c-43d6-8582-18d55dcf9a7b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1664 microversion: 2.20 time: 0.167777 Feb 03 03:00:24.518493 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 330/630] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:24 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1664 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:24.535385 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-95f30260-371d-4770-a11b-bcd1a113ad8a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24e446c5-4d2e-4036-ab84-da1147f06a6e"}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:00:24.536481 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-95f30260-371d-4770-a11b-bcd1a113ad8a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:24.542912 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-95f30260-371d-4770-a11b-bcd1a113ad8a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:24.543494 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-95f30260-371d-4770-a11b-bcd1a113ad8a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:24.544548 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-95f30260-371d-4770-a11b-bcd1a113ad8a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:24.545007 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-95f30260-371d-4770-a11b-bcd1a113ad8a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:24.835739 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-95f30260-371d-4770-a11b-bcd1a113ad8a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "POST /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.304081 Feb 03 03:00:24.836637 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 301/631] 10.222.0.31 () {62 vars in 1363 bytes} [Thu Feb 3 03:00:24 2022] POST /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b/os-volume_attachments => generated 188 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 03 03:00:24.950177 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-01d471b3-1b62-4700-9b35-c6a887fd933d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:00:24.950742 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-01d471b3-1b62-4700-9b35-c6a887fd933d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:24.957236 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-01d471b3-1b62-4700-9b35-c6a887fd933d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:24.957694 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-01d471b3-1b62-4700-9b35-c6a887fd933d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:24.958530 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-01d471b3-1b62-4700-9b35-c6a887fd933d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:24.959148 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-01d471b3-1b62-4700-9b35-c6a887fd933d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:25.050507 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-01d471b3-1b62-4700-9b35-c6a887fd933d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "POST /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b/action" status: 202 len: 0 microversion: 2.20 time: 0.104071 Feb 03 03:00:25.051107 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 331/632] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Feb 3 03:00:24 2022] POST /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 03 03:00:25.059349 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-0d7015f0-46f7-4424-af93-486c2af1b24a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:25.059940 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-0d7015f0-46f7-4424-af93-486c2af1b24a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:25.066667 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0d7015f0-46f7-4424-af93-486c2af1b24a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:25.067110 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0d7015f0-46f7-4424-af93-486c2af1b24a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:25.068176 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0d7015f0-46f7-4424-af93-486c2af1b24a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:25.068602 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0d7015f0-46f7-4424-af93-486c2af1b24a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:25.211938 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-0d7015f0-46f7-4424-af93-486c2af1b24a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:25.220644 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-0d7015f0-46f7-4424-af93-486c2af1b24a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:25.222159 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-0d7015f0-46f7-4424-af93-486c2af1b24a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:25.223313 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-0d7015f0-46f7-4424-af93-486c2af1b24a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1750 microversion: 2.20 time: 0.167854 Feb 03 03:00:25.223938 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 302/633] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:25 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1750 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:26.244019 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-cdaa2d3c-b0a8-4101-b335-059f1bddbdf1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:26.244567 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-cdaa2d3c-b0a8-4101-b335-059f1bddbdf1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:26.253628 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cdaa2d3c-b0a8-4101-b335-059f1bddbdf1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:26.254276 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cdaa2d3c-b0a8-4101-b335-059f1bddbdf1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:26.255509 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cdaa2d3c-b0a8-4101-b335-059f1bddbdf1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:26.256184 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cdaa2d3c-b0a8-4101-b335-059f1bddbdf1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:26.390828 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-cdaa2d3c-b0a8-4101-b335-059f1bddbdf1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:26.399126 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-cdaa2d3c-b0a8-4101-b335-059f1bddbdf1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:26.400605 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-cdaa2d3c-b0a8-4101-b335-059f1bddbdf1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:26.401860 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-cdaa2d3c-b0a8-4101-b335-059f1bddbdf1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1752 microversion: 2.20 time: 0.162291 Feb 03 03:00:26.402406 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 332/634] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:26 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 03 03:00:27.420838 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-b48effa7-68e3-4f86-b76c-dad3b9746d6f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:27.422052 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-b48effa7-68e3-4f86-b76c-dad3b9746d6f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:27.434784 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b48effa7-68e3-4f86-b76c-dad3b9746d6f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:27.435225 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b48effa7-68e3-4f86-b76c-dad3b9746d6f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:27.436016 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b48effa7-68e3-4f86-b76c-dad3b9746d6f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:27.436441 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b48effa7-68e3-4f86-b76c-dad3b9746d6f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:27.641594 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-b48effa7-68e3-4f86-b76c-dad3b9746d6f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:27.650132 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-b48effa7-68e3-4f86-b76c-dad3b9746d6f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:27.651675 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-b48effa7-68e3-4f86-b76c-dad3b9746d6f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:27.652854 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-b48effa7-68e3-4f86-b76c-dad3b9746d6f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1808 microversion: 2.20 time: 0.235788 Feb 03 03:00:27.653388 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 303/635] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:27 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1808 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:28.671476 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-a34848ee-75ac-428e-ba34-96ff155db052 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:28.672855 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-a34848ee-75ac-428e-ba34-96ff155db052 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:28.683379 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a34848ee-75ac-428e-ba34-96ff155db052 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:28.684157 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a34848ee-75ac-428e-ba34-96ff155db052 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:28.687129 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a34848ee-75ac-428e-ba34-96ff155db052 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:28.687684 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a34848ee-75ac-428e-ba34-96ff155db052 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:28.864845 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-a34848ee-75ac-428e-ba34-96ff155db052 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:28.874618 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-a34848ee-75ac-428e-ba34-96ff155db052 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:28.876300 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-a34848ee-75ac-428e-ba34-96ff155db052 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:28.886617 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-a34848ee-75ac-428e-ba34-96ff155db052 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1808 microversion: 2.20 time: 0.219077 Feb 03 03:00:28.888547 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 333/636] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:28 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:29.906702 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-30213d7d-39d4-4577-8081-613fcd4ba3ce tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:29.907394 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-30213d7d-39d4-4577-8081-613fcd4ba3ce tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:29.913872 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-30213d7d-39d4-4577-8081-613fcd4ba3ce tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:29.914314 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-30213d7d-39d4-4577-8081-613fcd4ba3ce tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:29.915083 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-30213d7d-39d4-4577-8081-613fcd4ba3ce tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:29.915510 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-30213d7d-39d4-4577-8081-613fcd4ba3ce tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:30.067064 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-30213d7d-39d4-4577-8081-613fcd4ba3ce tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:30.082423 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-30213d7d-39d4-4577-8081-613fcd4ba3ce tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:30.087232 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-30213d7d-39d4-4577-8081-613fcd4ba3ce tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:30.089096 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-30213d7d-39d4-4577-8081-613fcd4ba3ce tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1808 microversion: 2.20 time: 0.185132 Feb 03 03:00:30.089227 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 304/637] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:29 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:31.107028 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-984d043b-dd74-4a0d-baf1-575f36f023ff tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:31.107628 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-984d043b-dd74-4a0d-baf1-575f36f023ff tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:31.114172 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-984d043b-dd74-4a0d-baf1-575f36f023ff tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:31.114869 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-984d043b-dd74-4a0d-baf1-575f36f023ff tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:31.116228 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-984d043b-dd74-4a0d-baf1-575f36f023ff tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:31.116965 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-984d043b-dd74-4a0d-baf1-575f36f023ff tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:31.260892 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-984d043b-dd74-4a0d-baf1-575f36f023ff tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:31.270570 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-984d043b-dd74-4a0d-baf1-575f36f023ff tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:31.272558 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-984d043b-dd74-4a0d-baf1-575f36f023ff tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:31.274206 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-984d043b-dd74-4a0d-baf1-575f36f023ff tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1808 microversion: 2.20 time: 0.171208 Feb 03 03:00:31.274945 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 334/638] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:31 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:32.293225 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-47d22533-fb1c-4510-b254-f36c31fbe359 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:32.294161 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-47d22533-fb1c-4510-b254-f36c31fbe359 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:32.302377 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-47d22533-fb1c-4510-b254-f36c31fbe359 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:32.303437 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-47d22533-fb1c-4510-b254-f36c31fbe359 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:32.304219 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-47d22533-fb1c-4510-b254-f36c31fbe359 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:32.304657 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-47d22533-fb1c-4510-b254-f36c31fbe359 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:32.453756 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-47d22533-fb1c-4510-b254-f36c31fbe359 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:32.462642 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-47d22533-fb1c-4510-b254-f36c31fbe359 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:32.464118 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-47d22533-fb1c-4510-b254-f36c31fbe359 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:32.465348 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-47d22533-fb1c-4510-b254-f36c31fbe359 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1808 microversion: 2.20 time: 0.176356 Feb 03 03:00:32.465914 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 305/639] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:32 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:33.483706 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-49e85731-6a61-4f0d-8629-b0e5df958484 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:33.485091 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-49e85731-6a61-4f0d-8629-b0e5df958484 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:33.492260 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-49e85731-6a61-4f0d-8629-b0e5df958484 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:33.492845 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-49e85731-6a61-4f0d-8629-b0e5df958484 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:33.493730 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-49e85731-6a61-4f0d-8629-b0e5df958484 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:33.494259 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-49e85731-6a61-4f0d-8629-b0e5df958484 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:33.636075 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-49e85731-6a61-4f0d-8629-b0e5df958484 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:33.644634 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-49e85731-6a61-4f0d-8629-b0e5df958484 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:33.646194 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-49e85731-6a61-4f0d-8629-b0e5df958484 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:33.647351 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-49e85731-6a61-4f0d-8629-b0e5df958484 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1808 microversion: 2.20 time: 0.167512 Feb 03 03:00:33.647906 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 335/640] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:33 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:34.666204 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-82c86ee0-2c8c-4e11-98c2-80651e1d08d2 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:34.666904 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-82c86ee0-2c8c-4e11-98c2-80651e1d08d2 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:34.673487 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-82c86ee0-2c8c-4e11-98c2-80651e1d08d2 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:34.673931 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-82c86ee0-2c8c-4e11-98c2-80651e1d08d2 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:34.674721 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-82c86ee0-2c8c-4e11-98c2-80651e1d08d2 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:34.675328 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-82c86ee0-2c8c-4e11-98c2-80651e1d08d2 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:34.816494 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-82c86ee0-2c8c-4e11-98c2-80651e1d08d2 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:34.825683 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-82c86ee0-2c8c-4e11-98c2-80651e1d08d2 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:34.827168 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-82c86ee0-2c8c-4e11-98c2-80651e1d08d2 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:34.828316 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-82c86ee0-2c8c-4e11-98c2-80651e1d08d2 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1808 microversion: 2.20 time: 0.166410 Feb 03 03:00:34.828896 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 306/641] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:34 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 03 03:00:35.847328 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-1572001d-db8f-4444-9dff-5d292baac7af tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:35.847954 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-1572001d-db8f-4444-9dff-5d292baac7af tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:35.855373 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1572001d-db8f-4444-9dff-5d292baac7af tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:35.855813 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1572001d-db8f-4444-9dff-5d292baac7af tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:35.856597 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1572001d-db8f-4444-9dff-5d292baac7af tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:35.857231 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1572001d-db8f-4444-9dff-5d292baac7af tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:36.285337 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-1572001d-db8f-4444-9dff-5d292baac7af tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:36.294129 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-1572001d-db8f-4444-9dff-5d292baac7af tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:36.295604 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-1572001d-db8f-4444-9dff-5d292baac7af tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:36.296791 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-1572001d-db8f-4444-9dff-5d292baac7af tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1808 microversion: 2.20 time: 0.453444 Feb 03 03:00:36.297353 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 336/642] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:35 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1808 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:37.314911 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-82ee36af-d1e5-423e-b455-9f90b95def99 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:37.315492 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-82ee36af-d1e5-423e-b455-9f90b95def99 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:37.321910 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-82ee36af-d1e5-423e-b455-9f90b95def99 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:37.322354 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-82ee36af-d1e5-423e-b455-9f90b95def99 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:37.323118 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-82ee36af-d1e5-423e-b455-9f90b95def99 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:37.323544 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-82ee36af-d1e5-423e-b455-9f90b95def99 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:37.458358 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-82ee36af-d1e5-423e-b455-9f90b95def99 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:37.468108 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-82ee36af-d1e5-423e-b455-9f90b95def99 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:37.469991 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-82ee36af-d1e5-423e-b455-9f90b95def99 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:37.471182 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-82ee36af-d1e5-423e-b455-9f90b95def99 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1808 microversion: 2.20 time: 0.160001 Feb 03 03:00:37.471724 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 307/643] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:37 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:38.489539 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-eb93f66b-22ad-4a66-8314-601a6c795f2c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:38.490296 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-eb93f66b-22ad-4a66-8314-601a6c795f2c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:38.496898 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-eb93f66b-22ad-4a66-8314-601a6c795f2c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:38.497342 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-eb93f66b-22ad-4a66-8314-601a6c795f2c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:38.498116 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-eb93f66b-22ad-4a66-8314-601a6c795f2c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:38.498541 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-eb93f66b-22ad-4a66-8314-601a6c795f2c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:38.633720 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-eb93f66b-22ad-4a66-8314-601a6c795f2c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:38.642391 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-eb93f66b-22ad-4a66-8314-601a6c795f2c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:38.643846 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-eb93f66b-22ad-4a66-8314-601a6c795f2c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:38.645018 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-eb93f66b-22ad-4a66-8314-601a6c795f2c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1808 microversion: 2.20 time: 0.159170 Feb 03 03:00:38.645579 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 337/644] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:38 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:39.663667 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-4a512cf2-7888-46dc-ac7b-9f205e328e11 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:39.664229 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-4a512cf2-7888-46dc-ac7b-9f205e328e11 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:39.671359 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4a512cf2-7888-46dc-ac7b-9f205e328e11 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:39.671800 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4a512cf2-7888-46dc-ac7b-9f205e328e11 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:39.672580 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4a512cf2-7888-46dc-ac7b-9f205e328e11 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:39.673036 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4a512cf2-7888-46dc-ac7b-9f205e328e11 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:39.810668 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-4a512cf2-7888-46dc-ac7b-9f205e328e11 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:39.826494 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-4a512cf2-7888-46dc-ac7b-9f205e328e11 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:39.826494 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-4a512cf2-7888-46dc-ac7b-9f205e328e11 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:39.826494 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-4a512cf2-7888-46dc-ac7b-9f205e328e11 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1808 microversion: 2.20 time: 0.165865 Feb 03 03:00:39.826808 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 308/645] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:39 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:40.847740 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-2e421ad6-3602-45ae-80f2-971fafde07d7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:40.848698 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-2e421ad6-3602-45ae-80f2-971fafde07d7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:40.858029 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2e421ad6-3602-45ae-80f2-971fafde07d7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:40.858505 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2e421ad6-3602-45ae-80f2-971fafde07d7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:40.859287 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2e421ad6-3602-45ae-80f2-971fafde07d7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:40.859717 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2e421ad6-3602-45ae-80f2-971fafde07d7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:41.003033 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-2e421ad6-3602-45ae-80f2-971fafde07d7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:41.015918 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-2e421ad6-3602-45ae-80f2-971fafde07d7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:41.018238 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-2e421ad6-3602-45ae-80f2-971fafde07d7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:41.019919 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-2e421ad6-3602-45ae-80f2-971fafde07d7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1808 microversion: 2.20 time: 0.178111 Feb 03 03:00:41.020544 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 338/646] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:40 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:42.038367 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-521d4271-1b37-4a78-94e4-a9e1d9eb4fb4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:42.039068 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-521d4271-1b37-4a78-94e4-a9e1d9eb4fb4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:42.045676 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-521d4271-1b37-4a78-94e4-a9e1d9eb4fb4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:42.046113 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-521d4271-1b37-4a78-94e4-a9e1d9eb4fb4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:42.046881 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-521d4271-1b37-4a78-94e4-a9e1d9eb4fb4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:42.047304 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-521d4271-1b37-4a78-94e4-a9e1d9eb4fb4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:42.184745 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-521d4271-1b37-4a78-94e4-a9e1d9eb4fb4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:42.193326 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-521d4271-1b37-4a78-94e4-a9e1d9eb4fb4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:42.194901 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-521d4271-1b37-4a78-94e4-a9e1d9eb4fb4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:42.196132 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-521d4271-1b37-4a78-94e4-a9e1d9eb4fb4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1808 microversion: 2.20 time: 0.161538 Feb 03 03:00:42.206919 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 309/647] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:42 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:43.214935 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-2c4ed2f3-d7d4-4054-91a6-9fe769187f5d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:43.215559 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-2c4ed2f3-d7d4-4054-91a6-9fe769187f5d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:43.222317 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2c4ed2f3-d7d4-4054-91a6-9fe769187f5d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:43.222606 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2c4ed2f3-d7d4-4054-91a6-9fe769187f5d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:43.223783 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2c4ed2f3-d7d4-4054-91a6-9fe769187f5d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:43.224371 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2c4ed2f3-d7d4-4054-91a6-9fe769187f5d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:43.388556 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-2c4ed2f3-d7d4-4054-91a6-9fe769187f5d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:43.397250 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-2c4ed2f3-d7d4-4054-91a6-9fe769187f5d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:43.398749 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-2c4ed2f3-d7d4-4054-91a6-9fe769187f5d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:43.399907 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-2c4ed2f3-d7d4-4054-91a6-9fe769187f5d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1808 microversion: 2.20 time: 0.189389 Feb 03 03:00:43.406667 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 339/648] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:43 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:44.418162 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-950b5b9a-0c45-4cb1-9022-319b5ef3ed80 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:44.421158 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-950b5b9a-0c45-4cb1-9022-319b5ef3ed80 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:44.427866 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-950b5b9a-0c45-4cb1-9022-319b5ef3ed80 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:44.428354 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-950b5b9a-0c45-4cb1-9022-319b5ef3ed80 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:44.429367 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-950b5b9a-0c45-4cb1-9022-319b5ef3ed80 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:44.429994 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-950b5b9a-0c45-4cb1-9022-319b5ef3ed80 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:44.646402 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-950b5b9a-0c45-4cb1-9022-319b5ef3ed80 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:44.656769 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-950b5b9a-0c45-4cb1-9022-319b5ef3ed80 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:44.658749 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-950b5b9a-0c45-4cb1-9022-319b5ef3ed80 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:44.660082 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-950b5b9a-0c45-4cb1-9022-319b5ef3ed80 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1808 microversion: 2.20 time: 0.246177 Feb 03 03:00:44.660844 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 310/649] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:44 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1808 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:45.679398 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-f8ff5d9f-438c-4378-aeab-6b60aac1d728 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:45.680066 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-f8ff5d9f-438c-4378-aeab-6b60aac1d728 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:45.686596 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f8ff5d9f-438c-4378-aeab-6b60aac1d728 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:45.687162 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f8ff5d9f-438c-4378-aeab-6b60aac1d728 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:45.687988 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f8ff5d9f-438c-4378-aeab-6b60aac1d728 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:45.688381 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f8ff5d9f-438c-4378-aeab-6b60aac1d728 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:45.822820 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-f8ff5d9f-438c-4378-aeab-6b60aac1d728 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:45.831260 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-f8ff5d9f-438c-4378-aeab-6b60aac1d728 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:45.832705 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-f8ff5d9f-438c-4378-aeab-6b60aac1d728 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:45.833867 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-f8ff5d9f-438c-4378-aeab-6b60aac1d728 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1808 microversion: 2.20 time: 0.158580 Feb 03 03:00:45.834448 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 340/650] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:45 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:46.856526 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-135db494-9e29-4b1a-85bb-f85c81dde04b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:46.857619 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-135db494-9e29-4b1a-85bb-f85c81dde04b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:46.868481 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-135db494-9e29-4b1a-85bb-f85c81dde04b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:46.870354 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-135db494-9e29-4b1a-85bb-f85c81dde04b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:46.871653 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-135db494-9e29-4b1a-85bb-f85c81dde04b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:46.872078 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-135db494-9e29-4b1a-85bb-f85c81dde04b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:47.022759 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-135db494-9e29-4b1a-85bb-f85c81dde04b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:47.030991 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-135db494-9e29-4b1a-85bb-f85c81dde04b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:47.032469 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-135db494-9e29-4b1a-85bb-f85c81dde04b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:47.033842 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-135db494-9e29-4b1a-85bb-f85c81dde04b tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1808 microversion: 2.20 time: 0.184269 Feb 03 03:00:47.034400 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 311/651] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:46 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:47.103359 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-4af0d855-d9d3-4779-9558-0decfa5deaf3 req-f8589ce7-29ed-4181-98d7-c8b73aa982bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0708ed4-206d-484e-a2b4-dfb7733d415b", "name": "network-vif-plugged", "status": "completed", "tag": "27c8015c-4643-475a-85ae-a540d30129eb"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:00:47.104978 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:00:47.104978 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 03:00:47.112401 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-4af0d855-d9d3-4779-9558-0decfa5deaf3 req-f8589ce7-29ed-4181-98d7-c8b73aa982bc service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:47.112875 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-4af0d855-d9d3-4779-9558-0decfa5deaf3 req-f8589ce7-29ed-4181-98d7-c8b73aa982bc service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:47.123659 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-4af0d855-d9d3-4779-9558-0decfa5deaf3 req-f8589ce7-29ed-4181-98d7-c8b73aa982bc service nova] Creating event network-vif-plugged:27c8015c-4643-475a-85ae-a540d30129eb for instance e0708ed4-206d-484e-a2b4-dfb7733d415b on hv-cinder-82758 Feb 03 03:00:47.128459 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-4af0d855-d9d3-4779-9558-0decfa5deaf3 req-f8589ce7-29ed-4181-98d7-c8b73aa982bc service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029088 Feb 03 03:00:47.129078 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 341/652] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:00:48.051308 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-64d7d4b0-9151-4acb-850b-6798e4797425 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:48.051817 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-64d7d4b0-9151-4acb-850b-6798e4797425 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:48.058468 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-64d7d4b0-9151-4acb-850b-6798e4797425 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:48.058907 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-64d7d4b0-9151-4acb-850b-6798e4797425 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:48.059682 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-64d7d4b0-9151-4acb-850b-6798e4797425 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:48.060109 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-64d7d4b0-9151-4acb-850b-6798e4797425 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:48.205766 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-64d7d4b0-9151-4acb-850b-6798e4797425 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:48.214080 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-64d7d4b0-9151-4acb-850b-6798e4797425 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:48.215571 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-64d7d4b0-9151-4acb-850b-6798e4797425 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:48.216702 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-64d7d4b0-9151-4acb-850b-6798e4797425 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1808 microversion: 2.20 time: 0.169198 Feb 03 03:00:48.217322 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 312/653] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:48 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:49.235607 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-44a9a338-bd7d-4fa5-bd9e-51df6dfe975c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:49.236495 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-44a9a338-bd7d-4fa5-bd9e-51df6dfe975c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:49.242944 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-44a9a338-bd7d-4fa5-bd9e-51df6dfe975c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:49.243365 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-44a9a338-bd7d-4fa5-bd9e-51df6dfe975c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:49.244157 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-44a9a338-bd7d-4fa5-bd9e-51df6dfe975c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:49.244603 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-44a9a338-bd7d-4fa5-bd9e-51df6dfe975c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:49.393256 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-44a9a338-bd7d-4fa5-bd9e-51df6dfe975c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:49.401546 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-44a9a338-bd7d-4fa5-bd9e-51df6dfe975c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:49.404596 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-44a9a338-bd7d-4fa5-bd9e-51df6dfe975c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:49.405789 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-44a9a338-bd7d-4fa5-bd9e-51df6dfe975c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1808 microversion: 2.20 time: 0.174962 Feb 03 03:00:49.406402 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 342/654] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:49 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:00:50.423414 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-71889cb9-86fc-4018-93af-413a6ac3f5af tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:00:50.423925 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-71889cb9-86fc-4018-93af-413a6ac3f5af tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:00:50.430757 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-71889cb9-86fc-4018-93af-413a6ac3f5af tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:50.431215 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-71889cb9-86fc-4018-93af-413a6ac3f5af tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:50.431996 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-71889cb9-86fc-4018-93af-413a6ac3f5af tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:00:50.432433 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-71889cb9-86fc-4018-93af-413a6ac3f5af tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:00:50.573396 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-71889cb9-86fc-4018-93af-413a6ac3f5af tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:50.582527 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-71889cb9-86fc-4018-93af-413a6ac3f5af tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:50.583997 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-71889cb9-86fc-4018-93af-413a6ac3f5af tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:00:50.585174 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-71889cb9-86fc-4018-93af-413a6ac3f5af tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1795 microversion: 2.20 time: 0.165757 Feb 03 03:00:50.585732 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 313/655] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:00:50 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1795 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:01:05.301061 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-a2ab3e0d-71de-4a1e-a28f-0443f834d72e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:05.301971 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-a2ab3e0d-71de-4a1e-a28f-0443f834d72e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:05.308109 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a2ab3e0d-71de-4a1e-a28f-0443f834d72e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:05.308553 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a2ab3e0d-71de-4a1e-a28f-0443f834d72e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:05.309346 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a2ab3e0d-71de-4a1e-a28f-0443f834d72e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:05.309784 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a2ab3e0d-71de-4a1e-a28f-0443f834d72e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:05.342998 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-a2ab3e0d-71de-4a1e-a28f-0443f834d72e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045199 Feb 03 03:01:05.344018 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 343/656] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Feb 3 03:01:05 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 03 03:01:05.404473 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-33781c1d-030e-47b3-9db0-419566872474 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:05.405026 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-33781c1d-030e-47b3-9db0-419566872474 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:05.411596 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-33781c1d-030e-47b3-9db0-419566872474 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:05.412044 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-33781c1d-030e-47b3-9db0-419566872474 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:05.412914 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-33781c1d-030e-47b3-9db0-419566872474 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:05.413350 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-33781c1d-030e-47b3-9db0-419566872474 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:05.439112 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-33781c1d-030e-47b3-9db0-419566872474 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Going to try to terminate instance {{(pid=116385) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 03 03:01:05.518052 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-33781c1d-030e-47b3-9db0-419566872474 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "DELETE /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 204 len: 0 microversion: 2.1 time: 0.117069 Feb 03 03:01:05.518636 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 314/657] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Feb 3 03:01:05 2022] DELETE /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 03 03:01:05.526908 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-2e87bf17-794f-45d6-9bb2-4f1664f8c3dc tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:05.527984 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-2e87bf17-794f-45d6-9bb2-4f1664f8c3dc tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:05.534093 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2e87bf17-794f-45d6-9bb2-4f1664f8c3dc tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:05.534540 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2e87bf17-794f-45d6-9bb2-4f1664f8c3dc tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:05.535317 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2e87bf17-794f-45d6-9bb2-4f1664f8c3dc tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:05.535743 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2e87bf17-794f-45d6-9bb2-4f1664f8c3dc tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:05.674656 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-2e87bf17-794f-45d6-9bb2-4f1664f8c3dc tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:05.682347 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-2e87bf17-794f-45d6-9bb2-4f1664f8c3dc tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1675 microversion: 2.1 time: 0.159105 Feb 03 03:01:05.683326 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 344/658] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:05 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:06.700257 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-9fb6ab76-476b-4fff-9724-1cbd6e84fefd tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:06.701022 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-9fb6ab76-476b-4fff-9724-1cbd6e84fefd tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:06.707513 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9fb6ab76-476b-4fff-9724-1cbd6e84fefd tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:06.707961 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9fb6ab76-476b-4fff-9724-1cbd6e84fefd tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:06.708762 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9fb6ab76-476b-4fff-9724-1cbd6e84fefd tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:06.709200 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9fb6ab76-476b-4fff-9724-1cbd6e84fefd tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:06.846328 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-9fb6ab76-476b-4fff-9724-1cbd6e84fefd tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:06.854555 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-9fb6ab76-476b-4fff-9724-1cbd6e84fefd tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1675 microversion: 2.1 time: 0.158678 Feb 03 03:01:06.855154 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 315/659] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:06 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:07.872753 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-f66db826-2c2c-41b8-900a-26ca62a3cb9b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:07.873365 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-f66db826-2c2c-41b8-900a-26ca62a3cb9b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:07.880373 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f66db826-2c2c-41b8-900a-26ca62a3cb9b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:07.880488 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f66db826-2c2c-41b8-900a-26ca62a3cb9b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:07.881224 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f66db826-2c2c-41b8-900a-26ca62a3cb9b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:07.881659 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f66db826-2c2c-41b8-900a-26ca62a3cb9b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:08.182928 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-f66db826-2c2c-41b8-900a-26ca62a3cb9b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:08.190932 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-f66db826-2c2c-41b8-900a-26ca62a3cb9b tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1675 microversion: 2.1 time: 0.321790 Feb 03 03:01:08.191554 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 345/660] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:07 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1675 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:08.749066 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-696ce0da-7b4c-4265-8d84-7e3ca0519f8a req-032acab1-429a-4948-8a96-3cc1bfcd9aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a00957e-c905-4466-8a03-befe71ab1e1c", "name": "network-vif-deleted", "tag": "303c8ce3-0afd-4cac-878f-a7307e3741d0"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:01:08.751265 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:01:08.751265 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:01:08.760001 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-696ce0da-7b4c-4265-8d84-7e3ca0519f8a req-032acab1-429a-4948-8a96-3cc1bfcd9aa4 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:08.760680 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-696ce0da-7b4c-4265-8d84-7e3ca0519f8a req-032acab1-429a-4948-8a96-3cc1bfcd9aa4 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:08.773731 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-696ce0da-7b4c-4265-8d84-7e3ca0519f8a req-032acab1-429a-4948-8a96-3cc1bfcd9aa4 service nova] Creating event network-vif-deleted:303c8ce3-0afd-4cac-878f-a7307e3741d0 for instance 9a00957e-c905-4466-8a03-befe71ab1e1c on hv-cinder-82758 Feb 03 03:01:08.778606 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-696ce0da-7b4c-4265-8d84-7e3ca0519f8a req-032acab1-429a-4948-8a96-3cc1bfcd9aa4 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033754 Feb 03 03:01:08.779202 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 316/661] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:01:09.207697 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-2eb733fc-8ec9-4a25-8d05-946521b24486 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:09.208298 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-2eb733fc-8ec9-4a25-8d05-946521b24486 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:09.214988 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2eb733fc-8ec9-4a25-8d05-946521b24486 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:09.215449 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2eb733fc-8ec9-4a25-8d05-946521b24486 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:09.216227 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2eb733fc-8ec9-4a25-8d05-946521b24486 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:09.216626 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2eb733fc-8ec9-4a25-8d05-946521b24486 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:09.282879 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-2eb733fc-8ec9-4a25-8d05-946521b24486 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:09.290701 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-2eb733fc-8ec9-4a25-8d05-946521b24486 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1607 microversion: 2.1 time: 0.086845 Feb 03 03:01:09.291465 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 346/662] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:09 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1607 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:10.308602 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-84278703-0bb3-4325-a7a2-0b6fbc5ea6af tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:10.309206 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-84278703-0bb3-4325-a7a2-0b6fbc5ea6af tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:10.315999 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-84278703-0bb3-4325-a7a2-0b6fbc5ea6af tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:10.316443 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-84278703-0bb3-4325-a7a2-0b6fbc5ea6af tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:10.317259 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-84278703-0bb3-4325-a7a2-0b6fbc5ea6af tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:10.317695 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-84278703-0bb3-4325-a7a2-0b6fbc5ea6af tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:10.379300 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-84278703-0bb3-4325-a7a2-0b6fbc5ea6af tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:10.386969 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-84278703-0bb3-4325-a7a2-0b6fbc5ea6af tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 200 len: 1323 microversion: 2.1 time: 0.083051 Feb 03 03:01:10.387541 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 317/663] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:10 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 1323 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:11.403962 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-0c7b44cc-ca1f-4489-aeba-6746a7a2f328 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:11.404779 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-0c7b44cc-ca1f-4489-aeba-6746a7a2f328 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:11.412199 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0c7b44cc-ca1f-4489-aeba-6746a7a2f328 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:11.413217 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0c7b44cc-ca1f-4489-aeba-6746a7a2f328 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:11.414300 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0c7b44cc-ca1f-4489-aeba-6746a7a2f328 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:11.414985 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0c7b44cc-ca1f-4489-aeba-6746a7a2f328 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:11.430963 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.wsgi [None req-0c7b44cc-ca1f-4489-aeba-6746a7a2f328 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] HTTP exception thrown: Instance 9a00957e-c905-4466-8a03-befe71ab1e1c could not be found. Feb 03 03:01:11.431558 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-0c7b44cc-ca1f-4489-aeba-6746a7a2f328 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Returning 404 to user: Instance 9a00957e-c905-4466-8a03-befe71ab1e1c could not be found. {{(pid=116386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 03:01:11.432407 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-0c7b44cc-ca1f-4489-aeba-6746a7a2f328 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 404 len: 111 microversion: 2.1 time: 0.032869 Feb 03 03:01:11.433008 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 347/664] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:11 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 03:01:11.442522 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-fb25356e-4ed0-479c-9d91-0087cf51a9de tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '.version_select at 0x7ff99cfcfd30>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:11.464609 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-fb25356e-4ed0-479c-9d91-0087cf51a9de tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1323791635" status: 202 len: 0 microversion: 2.1 time: 0.026868 Feb 03 03:01:11.465289 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 318/665] 10.222.0.31 () {58 vars in 1220 bytes} [Thu Feb 3 03:01:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1323791635 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 03 03:01:12.098665 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-6a0e2b92-f472-46c1-9178-3b9a1566cbf3 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Action: 'create', calling method: .version_select at 0x7ff99cea48b0>, body: {"keypair": {"name": "tempest-keypair-552541862"}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:01:12.112591 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.quota [None req-6a0e2b92-f472-46c1-9178-3b9a1566cbf3 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Getting quotas for project 5c189a73642b4f5ba787addbc275d4c0. Resources: {'key_pairs'} {{(pid=116386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 03:01:12.116550 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.quota [None req-6a0e2b92-f472-46c1-9178-3b9a1566cbf3 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Getting quotas for user 076a8d1b26864240a8007d2ac7080e0b and project 5c189a73642b4f5ba787addbc275d4c0. Resources: {'key_pairs'} {{(pid=116386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 03:01:12.128581 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6a0e2b92-f472-46c1-9178-3b9a1566cbf3 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [122b1327-c2f7-4637-b0c6-5cd33c997789] AMQP server on 10.222.0.31:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 03 03:01:13.141071 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO oslo.messaging._drivers.impl_rabbit [None req-6a0e2b92-f472-46c1-9178-3b9a1566cbf3 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [122b1327-c2f7-4637-b0c6-5cd33c997789] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 39972. Feb 03 03:01:13.255811 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.quota [None req-6a0e2b92-f472-46c1-9178-3b9a1566cbf3 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Getting quotas for project 5c189a73642b4f5ba787addbc275d4c0. Resources: {'key_pairs'} {{(pid=116386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 03:01:13.259606 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.quota [None req-6a0e2b92-f472-46c1-9178-3b9a1566cbf3 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Getting quotas for user 076a8d1b26864240a8007d2ac7080e0b and project 5c189a73642b4f5ba787addbc275d4c0. Resources: {'key_pairs'} {{(pid=116386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 03:01:13.272641 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-6a0e2b92-f472-46c1-9178-3b9a1566cbf3 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.177575 Feb 03 03:01:13.273219 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 348/666] 10.222.0.31 () {60 vars in 1157 bytes} [Thu Feb 3 03:01:12 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:14.551980 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-84fe9565-1cc5-44a0-a247-27aee5688afa tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1520043778", "imageRef": "99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6402c879-2200-432c-9a4b-8fd0476dc339"}], "security_groups": [{"name": "tempest-securitygroup--956420318"}], "key_name": "tempest-keypair-552541862", "user_data": "}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:01:14.657285 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.network.neutron [None req-84fe9565-1cc5-44a0-a247-27aee5688afa tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] validate_networks() for [('6402c879-2200-432c-9a4b-8fd0476dc339', None, None, None, None, None)] {{(pid=116385) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 03 03:01:15.025468 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-84fe9565-1cc5-44a0-a247-27aee5688afa tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Flavor limits 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 03 03:01:15.025874 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-84fe9565-1cc5-44a0-a247-27aee5688afa tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Image limits 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 03 03:01:15.026299 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-84fe9565-1cc5-44a0-a247-27aee5688afa tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Flavor pref 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 03 03:01:15.026699 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-84fe9565-1cc5-44a0-a247-27aee5688afa tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Image pref 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 03 03:01:15.027092 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-84fe9565-1cc5-44a0-a247-27aee5688afa tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 03 03:01:15.035623 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-84fe9565-1cc5-44a0-a247-27aee5688afa tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:15.036057 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-84fe9565-1cc5-44a0-a247-27aee5688afa tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:15.036873 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-84fe9565-1cc5-44a0-a247-27aee5688afa tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:15.037329 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-84fe9565-1cc5-44a0-a247-27aee5688afa tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:15.052990 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-84fe9565-1cc5-44a0-a247-27aee5688afa tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Getting quotas for project 5c189a73642b4f5ba787addbc275d4c0. Resources: {'cores', 'ram', 'instances'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 03:01:15.056806 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-84fe9565-1cc5-44a0-a247-27aee5688afa tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Getting quotas for user 076a8d1b26864240a8007d2ac7080e0b and project 5c189a73642b4f5ba787addbc275d4c0. Resources: {'cores', 'ram', 'instances'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 03:01:15.068117 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-84fe9565-1cc5-44a0-a247-27aee5688afa tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Going to run 1 instances... {{(pid=116385) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 03 03:01:15.070515 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-84fe9565-1cc5-44a0-a247-27aee5688afa tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 03 03:01:15.118685 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-84fe9565-1cc5-44a0-a247-27aee5688afa tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.571301 Feb 03 03:01:15.119498 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 319/667] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Feb 3 03:01:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 03 03:01:15.129398 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-11bcc188-bb27-4edd-9a72-1510e1357ce4 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:15.130061 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-11bcc188-bb27-4edd-9a72-1510e1357ce4 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:15.196810 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-11bcc188-bb27-4edd-9a72-1510e1357ce4 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:15.203532 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-11bcc188-bb27-4edd-9a72-1510e1357ce4 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f" status: 200 len: 1237 microversion: 2.1 time: 0.077900 Feb 03 03:01:15.204102 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 349/668] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:15 2022] GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f => generated 1237 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:16.221448 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-061823cb-06fa-4b38-bfde-7715aa7a0c4a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:16.223067 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-061823cb-06fa-4b38-bfde-7715aa7a0c4a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:16.235340 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-061823cb-06fa-4b38-bfde-7715aa7a0c4a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:16.235927 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-061823cb-06fa-4b38-bfde-7715aa7a0c4a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:16.237054 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-061823cb-06fa-4b38-bfde-7715aa7a0c4a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:16.237638 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-061823cb-06fa-4b38-bfde-7715aa7a0c4a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:16.348384 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-061823cb-06fa-4b38-bfde-7715aa7a0c4a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:16.356580 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-061823cb-06fa-4b38-bfde-7715aa7a0c4a tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f" status: 200 len: 1295 microversion: 2.1 time: 0.140782 Feb 03 03:01:16.357307 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 320/669] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:16 2022] GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f => generated 1295 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:17.377038 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-8dbbfc12-04d4-4cb9-a32b-2dbaea3d2ee2 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:17.377655 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-8dbbfc12-04d4-4cb9-a32b-2dbaea3d2ee2 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:17.384563 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8dbbfc12-04d4-4cb9-a32b-2dbaea3d2ee2 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:17.385300 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8dbbfc12-04d4-4cb9-a32b-2dbaea3d2ee2 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:17.386204 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8dbbfc12-04d4-4cb9-a32b-2dbaea3d2ee2 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:17.386920 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8dbbfc12-04d4-4cb9-a32b-2dbaea3d2ee2 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:17.543350 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-39aaf78c-8883-453f-bd23-d988e45cd3c2 req-d48fc179-9c90-4baf-9ea9-552927b053b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb0bed4d-5279-4855-a809-a182517f5a6f", "tag": "d06bb55a-14cb-478e-8943-fb3e7c453450"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:01:17.546670 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:01:17.546670 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:01:17.556709 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-39aaf78c-8883-453f-bd23-d988e45cd3c2 req-d48fc179-9c90-4baf-9ea9-552927b053b8 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:17.557968 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-39aaf78c-8883-453f-bd23-d988e45cd3c2 req-d48fc179-9c90-4baf-9ea9-552927b053b8 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:17.572326 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-39aaf78c-8883-453f-bd23-d988e45cd3c2 req-d48fc179-9c90-4baf-9ea9-552927b053b8 service nova] Creating event network-changed:d06bb55a-14cb-478e-8943-fb3e7c453450 for instance bb0bed4d-5279-4855-a809-a182517f5a6f on hv-cinder-82758 Feb 03 03:01:17.579850 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-39aaf78c-8883-453f-bd23-d988e45cd3c2 req-d48fc179-9c90-4baf-9ea9-552927b053b8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040850 Feb 03 03:01:17.581993 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 321/670] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:01:17.638506 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-8dbbfc12-04d4-4cb9-a32b-2dbaea3d2ee2 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:17.647398 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-8dbbfc12-04d4-4cb9-a32b-2dbaea3d2ee2 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f" status: 200 len: 1362 microversion: 2.1 time: 0.274102 Feb 03 03:01:17.648610 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 350/671] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:17 2022] GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:18.665349 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-d505963f-c26b-42cb-bc7b-97026f66d14d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:18.666052 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-d505963f-c26b-42cb-bc7b-97026f66d14d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:18.673031 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d505963f-c26b-42cb-bc7b-97026f66d14d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:18.673481 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d505963f-c26b-42cb-bc7b-97026f66d14d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:18.674263 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d505963f-c26b-42cb-bc7b-97026f66d14d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:18.674703 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d505963f-c26b-42cb-bc7b-97026f66d14d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:18.809018 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-d505963f-c26b-42cb-bc7b-97026f66d14d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:18.817519 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-d505963f-c26b-42cb-bc7b-97026f66d14d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f" status: 200 len: 1362 microversion: 2.1 time: 0.156288 Feb 03 03:01:18.818109 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 322/672] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:18 2022] GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:19.834754 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-b8a0e0af-2766-4937-8789-e7a932fbe176 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:19.835449 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-b8a0e0af-2766-4937-8789-e7a932fbe176 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:19.841828 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b8a0e0af-2766-4937-8789-e7a932fbe176 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:19.842338 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b8a0e0af-2766-4937-8789-e7a932fbe176 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:19.843271 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b8a0e0af-2766-4937-8789-e7a932fbe176 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:19.843712 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b8a0e0af-2766-4937-8789-e7a932fbe176 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:19.981356 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-b8a0e0af-2766-4937-8789-e7a932fbe176 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:19.989016 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-b8a0e0af-2766-4937-8789-e7a932fbe176 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f" status: 200 len: 1362 microversion: 2.1 time: 0.157897 Feb 03 03:01:19.989661 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 351/673] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:19 2022] GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:21.007480 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-2bcf5e57-f134-4cb1-8c23-fa1546903e89 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:21.008014 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-2bcf5e57-f134-4cb1-8c23-fa1546903e89 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:21.019241 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2bcf5e57-f134-4cb1-8c23-fa1546903e89 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:21.020306 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2bcf5e57-f134-4cb1-8c23-fa1546903e89 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:21.021803 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2bcf5e57-f134-4cb1-8c23-fa1546903e89 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:21.022471 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2bcf5e57-f134-4cb1-8c23-fa1546903e89 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:21.166897 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-2bcf5e57-f134-4cb1-8c23-fa1546903e89 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:21.175101 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-2bcf5e57-f134-4cb1-8c23-fa1546903e89 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f" status: 200 len: 1362 microversion: 2.1 time: 0.171987 Feb 03 03:01:21.175731 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 323/674] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:21 2022] GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:22.193108 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-6c04620d-fdbd-4960-a202-baf99d6648b0 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:22.193716 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-6c04620d-fdbd-4960-a202-baf99d6648b0 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:22.200649 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6c04620d-fdbd-4960-a202-baf99d6648b0 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:22.201138 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6c04620d-fdbd-4960-a202-baf99d6648b0 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:22.201915 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6c04620d-fdbd-4960-a202-baf99d6648b0 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:22.202481 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6c04620d-fdbd-4960-a202-baf99d6648b0 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:22.342775 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-6c04620d-fdbd-4960-a202-baf99d6648b0 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:22.350463 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-6c04620d-fdbd-4960-a202-baf99d6648b0 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f" status: 200 len: 1362 microversion: 2.1 time: 0.161141 Feb 03 03:01:22.351039 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 352/675] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:22 2022] GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:23.037655 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-6b4aaec0-a3f3-4832-b446-22251edf67bc req-c5727a53-2e61-49af-b7cc-7859e89e3ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb0bed4d-5279-4855-a809-a182517f5a6f", "name": "network-vif-plugged", "status": "completed", "tag": "d06bb55a-14cb-478e-8943-fb3e7c453450"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:01:23.039181 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:01:23.039181 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:01:23.046718 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-6b4aaec0-a3f3-4832-b446-22251edf67bc req-c5727a53-2e61-49af-b7cc-7859e89e3ad0 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:23.047160 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-6b4aaec0-a3f3-4832-b446-22251edf67bc req-c5727a53-2e61-49af-b7cc-7859e89e3ad0 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:23.058670 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-6b4aaec0-a3f3-4832-b446-22251edf67bc req-c5727a53-2e61-49af-b7cc-7859e89e3ad0 service nova] Creating event network-vif-plugged:d06bb55a-14cb-478e-8943-fb3e7c453450 for instance bb0bed4d-5279-4855-a809-a182517f5a6f on hv-cinder-82758 Feb 03 03:01:23.063953 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-6b4aaec0-a3f3-4832-b446-22251edf67bc req-c5727a53-2e61-49af-b7cc-7859e89e3ad0 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029926 Feb 03 03:01:23.064550 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 324/676] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:01:23.370952 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-27de71d4-8082-49ce-8ca1-8a368eb57321 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:23.371913 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-27de71d4-8082-49ce-8ca1-8a368eb57321 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:23.383025 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-27de71d4-8082-49ce-8ca1-8a368eb57321 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:23.383899 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-27de71d4-8082-49ce-8ca1-8a368eb57321 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:23.385490 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-27de71d4-8082-49ce-8ca1-8a368eb57321 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:23.386065 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-27de71d4-8082-49ce-8ca1-8a368eb57321 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:23.534757 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-27de71d4-8082-49ce-8ca1-8a368eb57321 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:23.542700 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-27de71d4-8082-49ce-8ca1-8a368eb57321 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f" status: 200 len: 1362 microversion: 2.1 time: 0.178306 Feb 03 03:01:23.543320 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 353/677] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:23 2022] GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:24.560486 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-c96a01d0-4152-48a2-aa47-fb2463fbc9c0 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:24.561259 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-c96a01d0-4152-48a2-aa47-fb2463fbc9c0 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:24.567690 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c96a01d0-4152-48a2-aa47-fb2463fbc9c0 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:24.568675 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c96a01d0-4152-48a2-aa47-fb2463fbc9c0 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:24.569495 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c96a01d0-4152-48a2-aa47-fb2463fbc9c0 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:24.569927 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c96a01d0-4152-48a2-aa47-fb2463fbc9c0 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:24.713901 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-c96a01d0-4152-48a2-aa47-fb2463fbc9c0 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:24.721717 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-c96a01d0-4152-48a2-aa47-fb2463fbc9c0 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f" status: 200 len: 1548 microversion: 2.1 time: 0.165783 Feb 03 03:01:24.722321 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 325/678] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:24 2022] GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f => generated 1548 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:24.739468 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-9e4d705c-0d50-4947-9665-fcf53e28c433 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:24.740007 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-9e4d705c-0d50-4947-9665-fcf53e28c433 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:24.747092 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-9e4d705c-0d50-4947-9665-fcf53e28c433 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:24.747545 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-9e4d705c-0d50-4947-9665-fcf53e28c433 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:24.748360 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-9e4d705c-0d50-4947-9665-fcf53e28c433 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:24.748803 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-9e4d705c-0d50-4947-9665-fcf53e28c433 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:24.837664 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-9e4d705c-0d50-4947-9665-fcf53e28c433 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102904 Feb 03 03:01:24.838240 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 354/679] 10.222.0.31 () {58 vars in 1274 bytes} [Thu Feb 3 03:01:24 2022] GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:01:25.817121 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-4d596fbf-ac81-4e20-97fb-24280ed766c4 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:25.818452 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-4d596fbf-ac81-4e20-97fb-24280ed766c4 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:25.819717 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-0772c4a4-c281-4faf-bd65-2f2def7888ce req-7a85573c-7528-44d8-b8ac-3c424cbd0f14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb0bed4d-5279-4855-a809-a182517f5a6f", "tag": "d06bb55a-14cb-478e-8943-fb3e7c453450"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:01:25.821277 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:01:25.821277 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 03:01:25.825351 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4d596fbf-ac81-4e20-97fb-24280ed766c4 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:25.825879 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4d596fbf-ac81-4e20-97fb-24280ed766c4 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:25.826730 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4d596fbf-ac81-4e20-97fb-24280ed766c4 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:25.827173 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4d596fbf-ac81-4e20-97fb-24280ed766c4 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:25.829563 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-0772c4a4-c281-4faf-bd65-2f2def7888ce req-7a85573c-7528-44d8-b8ac-3c424cbd0f14 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:25.829862 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-0772c4a4-c281-4faf-bd65-2f2def7888ce req-7a85573c-7528-44d8-b8ac-3c424cbd0f14 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:25.842109 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-0772c4a4-c281-4faf-bd65-2f2def7888ce req-7a85573c-7528-44d8-b8ac-3c424cbd0f14 service nova] Creating event network-changed:d06bb55a-14cb-478e-8943-fb3e7c453450 for instance bb0bed4d-5279-4855-a809-a182517f5a6f on hv-cinder-82758 Feb 03 03:01:25.852017 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-0772c4a4-c281-4faf-bd65-2f2def7888ce req-7a85573c-7528-44d8-b8ac-3c424cbd0f14 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036626 Feb 03 03:01:25.853189 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 355/680] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:01:26.052026 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-4d596fbf-ac81-4e20-97fb-24280ed766c4 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:26.066038 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-4d596fbf-ac81-4e20-97fb-24280ed766c4 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f" status: 200 len: 1548 microversion: 2.1 time: 0.253056 Feb 03 03:01:26.066744 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 326/681] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:25 2022] GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f => generated 1548 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:27.086220 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-1a6d7087-5c57-4dcd-a867-e5275e40d58f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:27.087283 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-1a6d7087-5c57-4dcd-a867-e5275e40d58f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:27.094294 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1a6d7087-5c57-4dcd-a867-e5275e40d58f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:27.094730 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1a6d7087-5c57-4dcd-a867-e5275e40d58f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:27.095516 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1a6d7087-5c57-4dcd-a867-e5275e40d58f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:27.095942 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1a6d7087-5c57-4dcd-a867-e5275e40d58f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:27.234348 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-1a6d7087-5c57-4dcd-a867-e5275e40d58f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:27.242434 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-1a6d7087-5c57-4dcd-a867-e5275e40d58f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f" status: 200 len: 1666 microversion: 2.1 time: 0.162143 Feb 03 03:01:27.243238 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 356/682] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:27 2022] GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f => generated 1666 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:27.261349 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-d1ece293-abb9-44be-9d5a-dd0b72e76c90 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:27.261879 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-d1ece293-abb9-44be-9d5a-dd0b72e76c90 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:27.271352 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d1ece293-abb9-44be-9d5a-dd0b72e76c90 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:27.271984 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d1ece293-abb9-44be-9d5a-dd0b72e76c90 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:27.273145 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d1ece293-abb9-44be-9d5a-dd0b72e76c90 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:27.273861 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d1ece293-abb9-44be-9d5a-dd0b72e76c90 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:27.302893 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-d1ece293-abb9-44be-9d5a-dd0b72e76c90 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f/ips" status: 200 len: 145 microversion: 2.1 time: 0.047765 Feb 03 03:01:27.303490 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 327/683] 10.222.0.31 () {58 vars in 1247 bytes} [Thu Feb 3 03:01:27 2022] GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f/ips => generated 145 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:01:28.629140 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-16ee6c11-19ec-4098-bf10-4bc10f55ecb8 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "002805bd-443b-41f5-810b-3daa4c4a0d97"}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:01:28.630208 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-16ee6c11-19ec-4098-bf10-4bc10f55ecb8 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:28.636550 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-16ee6c11-19ec-4098-bf10-4bc10f55ecb8 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:28.637037 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-16ee6c11-19ec-4098-bf10-4bc10f55ecb8 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:28.637823 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-16ee6c11-19ec-4098-bf10-4bc10f55ecb8 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:28.638252 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-16ee6c11-19ec-4098-bf10-4bc10f55ecb8 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:28.880886 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-16ee6c11-19ec-4098-bf10-4bc10f55ecb8 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "POST /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255377 Feb 03 03:01:28.881491 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 357/684] 10.222.0.31 () {60 vars in 1322 bytes} [Thu Feb 3 03:01:28 2022] POST /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:01:32.146865 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-1ded57f3-2428-4863-8df2-48ff7acaa14f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:32.147451 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-1ded57f3-2428-4863-8df2-48ff7acaa14f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:32.153892 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1ded57f3-2428-4863-8df2-48ff7acaa14f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:32.154341 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1ded57f3-2428-4863-8df2-48ff7acaa14f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:32.156087 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1ded57f3-2428-4863-8df2-48ff7acaa14f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:32.156087 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1ded57f3-2428-4863-8df2-48ff7acaa14f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:32.188050 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-1ded57f3-2428-4863-8df2-48ff7acaa14f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b/os-volume_attachments/24e446c5-4d2e-4036-ab84-da1147f06a6e" status: 200 len: 194 microversion: 2.20 time: 0.046434 Feb 03 03:01:32.188627 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 328/685] 10.222.0.31 () {60 vars in 1453 bytes} [Thu Feb 3 03:01:32 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b/os-volume_attachments/24e446c5-4d2e-4036-ab84-da1147f06a6e => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 03 03:01:32.258436 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-5180555c-3b30-4aff-892a-99bf4120657a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:32.259045 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-5180555c-3b30-4aff-892a-99bf4120657a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:32.265824 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5180555c-3b30-4aff-892a-99bf4120657a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:32.266272 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5180555c-3b30-4aff-892a-99bf4120657a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:32.267054 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5180555c-3b30-4aff-892a-99bf4120657a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:32.267488 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5180555c-3b30-4aff-892a-99bf4120657a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:32.531496 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.objects.instance [None req-5180555c-3b30-4aff-892a-99bf4120657a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lazy-loading 'services' on Instance uuid e0708ed4-206d-484e-a2b4-dfb7733d415b {{(pid=116386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 03 03:01:32.613904 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-5180555c-3b30-4aff-892a-99bf4120657a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "DELETE /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b/os-volume_attachments/24e446c5-4d2e-4036-ab84-da1147f06a6e" status: 202 len: 0 microversion: 2.20 time: 0.359475 Feb 03 03:01:32.614527 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 358/686] 10.222.0.31 () {60 vars in 1456 bytes} [Thu Feb 3 03:01:32 2022] DELETE /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b/os-volume_attachments/24e446c5-4d2e-4036-ab84-da1147f06a6e => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 03 03:01:32.627664 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-ad8c36fa-23de-42ed-ba71-e1347952fad8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:32.628596 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-ad8c36fa-23de-42ed-ba71-e1347952fad8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:32.635124 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ad8c36fa-23de-42ed-ba71-e1347952fad8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:32.635641 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ad8c36fa-23de-42ed-ba71-e1347952fad8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:32.636426 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ad8c36fa-23de-42ed-ba71-e1347952fad8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:32.636925 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ad8c36fa-23de-42ed-ba71-e1347952fad8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:32.666631 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-ad8c36fa-23de-42ed-ba71-e1347952fad8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047482 Feb 03 03:01:32.667331 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 329/687] 10.222.0.31 () {60 vars in 1342 bytes} [Thu Feb 3 03:01:32 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 03 03:01:33.679841 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-4413a907-c85c-4103-9286-704b009750c0 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:33.681526 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-4413a907-c85c-4103-9286-704b009750c0 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:33.688643 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4413a907-c85c-4103-9286-704b009750c0 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:33.689133 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4413a907-c85c-4103-9286-704b009750c0 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:33.689923 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4413a907-c85c-4103-9286-704b009750c0 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:33.690385 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4413a907-c85c-4103-9286-704b009750c0 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:33.720370 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-4413a907-c85c-4103-9286-704b009750c0 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045406 Feb 03 03:01:33.720993 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 359/688] 10.222.0.31 () {60 vars in 1342 bytes} [Thu Feb 3 03:01:33 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 03 03:01:34.736079 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-386ab00d-ab43-42a0-b3f7-877201e327ed tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:34.737561 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-386ab00d-ab43-42a0-b3f7-877201e327ed tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:34.748109 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-386ab00d-ab43-42a0-b3f7-877201e327ed tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:34.748871 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-386ab00d-ab43-42a0-b3f7-877201e327ed tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:34.750132 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-386ab00d-ab43-42a0-b3f7-877201e327ed tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:34.750883 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-386ab00d-ab43-42a0-b3f7-877201e327ed tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:34.784056 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-386ab00d-ab43-42a0-b3f7-877201e327ed tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054251 Feb 03 03:01:34.784637 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 330/689] 10.222.0.31 () {60 vars in 1342 bytes} [Thu Feb 3 03:01:34 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 03 03:01:35.322842 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-2347b02d-a3e7-4049-a52c-ee271b537e91 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:35.324542 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-2347b02d-a3e7-4049-a52c-ee271b537e91 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:35.334244 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2347b02d-a3e7-4049-a52c-ee271b537e91 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:35.334893 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2347b02d-a3e7-4049-a52c-ee271b537e91 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:35.336111 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2347b02d-a3e7-4049-a52c-ee271b537e91 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:35.336755 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2347b02d-a3e7-4049-a52c-ee271b537e91 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:35.372301 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-2347b02d-a3e7-4049-a52c-ee271b537e91 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056317 Feb 03 03:01:35.372799 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 360/690] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Feb 3 03:01:35 2022] GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:01:35.382711 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-0fb940ce-42c0-4bbe-a6db-4bf7c813001d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:35.383195 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-0fb940ce-42c0-4bbe-a6db-4bf7c813001d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:35.389529 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0fb940ce-42c0-4bbe-a6db-4bf7c813001d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:35.389977 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0fb940ce-42c0-4bbe-a6db-4bf7c813001d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:35.390743 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0fb940ce-42c0-4bbe-a6db-4bf7c813001d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:35.391173 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0fb940ce-42c0-4bbe-a6db-4bf7c813001d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:35.419087 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-0fb940ce-42c0-4bbe-a6db-4bf7c813001d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f/os-volume_attachments/002805bd-443b-41f5-810b-3daa4c4a0d97" status: 200 len: 194 microversion: 2.1 time: 0.040231 Feb 03 03:01:35.419651 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 331/691] 10.222.0.31 () {58 vars in 1412 bytes} [Thu Feb 3 03:01:35 2022] GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f/os-volume_attachments/002805bd-443b-41f5-810b-3daa4c4a0d97 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:01:35.795430 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-fa242df1-c7e8-409d-b070-f3508b334276 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:35.796433 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-fa242df1-c7e8-409d-b070-f3508b334276 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:35.802777 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fa242df1-c7e8-409d-b070-f3508b334276 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:35.803295 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fa242df1-c7e8-409d-b070-f3508b334276 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:35.804177 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fa242df1-c7e8-409d-b070-f3508b334276 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:35.804605 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fa242df1-c7e8-409d-b070-f3508b334276 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:35.837313 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-fa242df1-c7e8-409d-b070-f3508b334276 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045560 Feb 03 03:01:35.838291 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 361/692] 10.222.0.31 () {60 vars in 1342 bytes} [Thu Feb 3 03:01:35 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 03 03:01:36.246697 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-c4882879-8773-4415-8445-926bf7f71bcb tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:01:36.247594 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-c4882879-8773-4415-8445-926bf7f71bcb tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:36.258849 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c4882879-8773-4415-8445-926bf7f71bcb tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:36.259326 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c4882879-8773-4415-8445-926bf7f71bcb tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:36.260109 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c4882879-8773-4415-8445-926bf7f71bcb tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:36.261276 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c4882879-8773-4415-8445-926bf7f71bcb tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:36.288832 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.objects.instance [None req-c4882879-8773-4415-8445-926bf7f71bcb tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lazy-loading 'flavor' on Instance uuid 76a23dfa-b676-4e5a-b50a-126b1edd49e5 {{(pid=116385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 03 03:01:36.364549 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-c4882879-8773-4415-8445-926bf7f71bcb tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "POST /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5/action" status: 202 len: 0 microversion: 2.1 time: 0.124099 Feb 03 03:01:36.365644 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 332/693] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Feb 3 03:01:36 2022] POST /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 03 03:01:36.373976 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-9475fe2e-5b7e-4294-97b9-999c9319567e tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:36.374713 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-9475fe2e-5b7e-4294-97b9-999c9319567e tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:36.381233 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-9475fe2e-5b7e-4294-97b9-999c9319567e tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:36.381792 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-9475fe2e-5b7e-4294-97b9-999c9319567e tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:36.382575 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-9475fe2e-5b7e-4294-97b9-999c9319567e tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:36.383014 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-9475fe2e-5b7e-4294-97b9-999c9319567e tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:36.520410 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-9475fe2e-5b7e-4294-97b9-999c9319567e tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:36.528551 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-9475fe2e-5b7e-4294-97b9-999c9319567e tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1571 microversion: 2.1 time: 0.158213 Feb 03 03:01:36.529187 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 362/694] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:36 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:36.758906 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-9dfe8edb-bc3c-4f94-86c5-43410cabb8d7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "181d6409-7281-4db6-80a2-32fd13b10686"}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:01:36.760464 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-9dfe8edb-bc3c-4f94-86c5-43410cabb8d7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:36.769590 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9dfe8edb-bc3c-4f94-86c5-43410cabb8d7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:36.770154 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9dfe8edb-bc3c-4f94-86c5-43410cabb8d7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:36.771374 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9dfe8edb-bc3c-4f94-86c5-43410cabb8d7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:36.772017 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9dfe8edb-bc3c-4f94-86c5-43410cabb8d7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:36.849355 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-443b4f00-e19f-4477-b7b3-690edf712095 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:36.850437 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-443b4f00-e19f-4477-b7b3-690edf712095 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:36.856750 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-443b4f00-e19f-4477-b7b3-690edf712095 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:36.857301 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-443b4f00-e19f-4477-b7b3-690edf712095 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:36.858178 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-443b4f00-e19f-4477-b7b3-690edf712095 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:36.858694 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-443b4f00-e19f-4477-b7b3-690edf712095 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:36.888542 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-443b4f00-e19f-4477-b7b3-690edf712095 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043479 Feb 03 03:01:36.894063 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 363/695] 10.222.0.31 () {60 vars in 1342 bytes} [Thu Feb 3 03:01:36 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:36.947179 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-01c77467-0177-422a-b810-77c4138c145e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:36.947744 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-01c77467-0177-422a-b810-77c4138c145e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:36.954161 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-01c77467-0177-422a-b810-77c4138c145e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:36.954580 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-01c77467-0177-422a-b810-77c4138c145e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:36.955487 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-01c77467-0177-422a-b810-77c4138c145e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:36.955874 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-01c77467-0177-422a-b810-77c4138c145e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:36.982417 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-01c77467-0177-422a-b810-77c4138c145e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Going to try to terminate instance {{(pid=116386) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 03 03:01:37.072353 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-01c77467-0177-422a-b810-77c4138c145e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "DELETE /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 204 len: 0 microversion: 2.20 time: 0.126737 Feb 03 03:01:37.072996 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 364/696] 10.222.0.31 () {60 vars in 1279 bytes} [Thu Feb 3 03:01:36 2022] DELETE /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 03 03:01:37.081649 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-838daa9c-d8d0-49d5-ab34-e698db71e5e2 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:37.082365 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-838daa9c-d8d0-49d5-ab34-e698db71e5e2 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:37.088346 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-838daa9c-d8d0-49d5-ab34-e698db71e5e2 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:37.088831 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-838daa9c-d8d0-49d5-ab34-e698db71e5e2 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:37.089621 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-838daa9c-d8d0-49d5-ab34-e698db71e5e2 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:37.090050 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-838daa9c-d8d0-49d5-ab34-e698db71e5e2 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:37.105173 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-9dfe8edb-bc3c-4f94-86c5-43410cabb8d7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "POST /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.352094 Feb 03 03:01:37.107140 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 333/697] 10.222.0.31 () {60 vars in 1322 bytes} [Thu Feb 3 03:01:36 2022] POST /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f/os-volume_attachments => generated 194 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:01:37.257583 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-838daa9c-d8d0-49d5-ab34-e698db71e5e2 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:37.266392 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-838daa9c-d8d0-49d5-ab34-e698db71e5e2 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:37.267882 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-838daa9c-d8d0-49d5-ab34-e698db71e5e2 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:37.269716 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-838daa9c-d8d0-49d5-ab34-e698db71e5e2 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1723 microversion: 2.20 time: 0.192282 Feb 03 03:01:37.280325 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 365/698] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:01:37 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 03 03:01:37.547238 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-8d040130-8562-4479-ad9a-706f3ac82842 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:37.547956 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-8d040130-8562-4479-ad9a-706f3ac82842 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:37.556532 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8d040130-8562-4479-ad9a-706f3ac82842 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:37.557075 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8d040130-8562-4479-ad9a-706f3ac82842 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:37.557987 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8d040130-8562-4479-ad9a-706f3ac82842 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:37.558538 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8d040130-8562-4479-ad9a-706f3ac82842 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:37.707071 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-8d040130-8562-4479-ad9a-706f3ac82842 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:37.714760 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-8d040130-8562-4479-ad9a-706f3ac82842 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1571 microversion: 2.1 time: 0.172467 Feb 03 03:01:37.715315 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 334/699] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:37 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1571 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:38.288558 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-7701ade1-dafd-4ced-8dc1-f5a263fd24c9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:38.289313 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-7701ade1-dafd-4ced-8dc1-f5a263fd24c9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:38.296135 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7701ade1-dafd-4ced-8dc1-f5a263fd24c9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:38.296576 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7701ade1-dafd-4ced-8dc1-f5a263fd24c9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:38.297386 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7701ade1-dafd-4ced-8dc1-f5a263fd24c9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:38.297811 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7701ade1-dafd-4ced-8dc1-f5a263fd24c9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:38.432994 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-7701ade1-dafd-4ced-8dc1-f5a263fd24c9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:38.441241 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-7701ade1-dafd-4ced-8dc1-f5a263fd24c9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:38.442715 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-7701ade1-dafd-4ced-8dc1-f5a263fd24c9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:38.443859 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-7701ade1-dafd-4ced-8dc1-f5a263fd24c9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1723 microversion: 2.20 time: 0.159839 Feb 03 03:01:38.444395 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 366/700] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:01:38 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:01:38.732274 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-4eaf78fb-5ec2-41e5-adac-d60a7296fffe tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:38.732893 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-4eaf78fb-5ec2-41e5-adac-d60a7296fffe tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:38.739907 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4eaf78fb-5ec2-41e5-adac-d60a7296fffe tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:38.740352 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4eaf78fb-5ec2-41e5-adac-d60a7296fffe tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:38.741162 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4eaf78fb-5ec2-41e5-adac-d60a7296fffe tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:38.741696 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4eaf78fb-5ec2-41e5-adac-d60a7296fffe tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:38.878646 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-4eaf78fb-5ec2-41e5-adac-d60a7296fffe tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:38.886102 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-4eaf78fb-5ec2-41e5-adac-d60a7296fffe tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1571 microversion: 2.1 time: 0.157534 Feb 03 03:01:38.886656 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 335/701] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:38 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:39.467257 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-c2fdd778-4217-4f44-bcdc-e0555a625526 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:39.468343 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-c2fdd778-4217-4f44-bcdc-e0555a625526 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:39.479580 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c2fdd778-4217-4f44-bcdc-e0555a625526 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:39.480317 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c2fdd778-4217-4f44-bcdc-e0555a625526 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:39.481637 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c2fdd778-4217-4f44-bcdc-e0555a625526 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:39.482347 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c2fdd778-4217-4f44-bcdc-e0555a625526 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:39.624989 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-c2fdd778-4217-4f44-bcdc-e0555a625526 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:39.633222 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-c2fdd778-4217-4f44-bcdc-e0555a625526 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:39.634704 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-c2fdd778-4217-4f44-bcdc-e0555a625526 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:39.635850 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-c2fdd778-4217-4f44-bcdc-e0555a625526 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1723 microversion: 2.20 time: 0.175078 Feb 03 03:01:39.636411 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 367/702] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:01:39 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:01:39.906791 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-f8222e41-4aa1-4cf4-876e-a7380b206622 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:39.907717 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-f8222e41-4aa1-4cf4-876e-a7380b206622 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:39.916610 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f8222e41-4aa1-4cf4-876e-a7380b206622 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:39.917086 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f8222e41-4aa1-4cf4-876e-a7380b206622 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:39.917845 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f8222e41-4aa1-4cf4-876e-a7380b206622 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:39.918270 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f8222e41-4aa1-4cf4-876e-a7380b206622 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:40.066235 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-f8222e41-4aa1-4cf4-876e-a7380b206622 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:40.074423 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-f8222e41-4aa1-4cf4-876e-a7380b206622 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1571 microversion: 2.1 time: 0.173777 Feb 03 03:01:40.074997 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 336/703] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:39 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1571 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:40.654237 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-8b935b72-37ee-4f32-b538-f8830c05e9ee tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:40.654828 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-8b935b72-37ee-4f32-b538-f8830c05e9ee tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:40.661658 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8b935b72-37ee-4f32-b538-f8830c05e9ee tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:40.662113 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8b935b72-37ee-4f32-b538-f8830c05e9ee tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:40.662882 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8b935b72-37ee-4f32-b538-f8830c05e9ee tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:40.663374 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8b935b72-37ee-4f32-b538-f8830c05e9ee tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:40.795879 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-8b935b72-37ee-4f32-b538-f8830c05e9ee tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:40.803670 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-8b935b72-37ee-4f32-b538-f8830c05e9ee tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:40.805164 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-8b935b72-37ee-4f32-b538-f8830c05e9ee tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:40.806303 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-8b935b72-37ee-4f32-b538-f8830c05e9ee tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1723 microversion: 2.20 time: 0.155798 Feb 03 03:01:40.806863 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 368/704] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:01:40 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:01:41.091585 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-32a8adeb-daf5-4b50-a8b3-2012becbfd9e tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:41.092216 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-32a8adeb-daf5-4b50-a8b3-2012becbfd9e tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:41.099578 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-32a8adeb-daf5-4b50-a8b3-2012becbfd9e tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:41.100038 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-32a8adeb-daf5-4b50-a8b3-2012becbfd9e tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:41.100881 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-32a8adeb-daf5-4b50-a8b3-2012becbfd9e tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:41.101324 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-32a8adeb-daf5-4b50-a8b3-2012becbfd9e tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:41.248943 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-32a8adeb-daf5-4b50-a8b3-2012becbfd9e tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:41.259188 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-32a8adeb-daf5-4b50-a8b3-2012becbfd9e tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1571 microversion: 2.1 time: 0.171486 Feb 03 03:01:41.259760 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 337/705] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:41 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1571 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:41.826281 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-dede663a-6ba5-4a8e-9617-899171bda417 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:41.827217 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-dede663a-6ba5-4a8e-9617-899171bda417 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:41.836358 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-dede663a-6ba5-4a8e-9617-899171bda417 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:41.836838 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-dede663a-6ba5-4a8e-9617-899171bda417 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:41.837605 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-dede663a-6ba5-4a8e-9617-899171bda417 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:41.838029 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-dede663a-6ba5-4a8e-9617-899171bda417 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:42.088040 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-dede663a-6ba5-4a8e-9617-899171bda417 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:42.095953 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-dede663a-6ba5-4a8e-9617-899171bda417 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:42.097452 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-dede663a-6ba5-4a8e-9617-899171bda417 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:42.098958 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-dede663a-6ba5-4a8e-9617-899171bda417 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 200 len: 1723 microversion: 2.20 time: 0.278840 Feb 03 03:01:42.099508 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 369/706] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:01:41 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:01:42.272709 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-9ac82250-7d24-4dde-94a7-f3c4d4683bc8 req-02eaae33-3bf2-439a-8edc-de7852c02e43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0708ed4-206d-484e-a2b4-dfb7733d415b", "name": "network-vif-deleted", "tag": "27c8015c-4643-475a-85ae-a540d30129eb"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:01:42.275144 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-0d9a5563-05d4-4830-8aeb-47824760f890 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:42.275724 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-0d9a5563-05d4-4830-8aeb-47824760f890 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:42.277634 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:01:42.277634 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:01:42.281970 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0d9a5563-05d4-4830-8aeb-47824760f890 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:42.282179 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0d9a5563-05d4-4830-8aeb-47824760f890 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:42.282978 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0d9a5563-05d4-4830-8aeb-47824760f890 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:42.283402 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0d9a5563-05d4-4830-8aeb-47824760f890 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:42.288824 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-9ac82250-7d24-4dde-94a7-f3c4d4683bc8 req-02eaae33-3bf2-439a-8edc-de7852c02e43 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:42.289535 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-9ac82250-7d24-4dde-94a7-f3c4d4683bc8 req-02eaae33-3bf2-439a-8edc-de7852c02e43 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:42.317160 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-9ac82250-7d24-4dde-94a7-f3c4d4683bc8 req-02eaae33-3bf2-439a-8edc-de7852c02e43 service nova] Creating event network-vif-deleted:27c8015c-4643-475a-85ae-a540d30129eb for instance e0708ed4-206d-484e-a2b4-dfb7733d415b on hv-cinder-82758 Feb 03 03:01:42.322606 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-9ac82250-7d24-4dde-94a7-f3c4d4683bc8 req-02eaae33-3bf2-439a-8edc-de7852c02e43 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053494 Feb 03 03:01:42.323562 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 338/707] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:01:42.433214 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-0d9a5563-05d4-4830-8aeb-47824760f890 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:42.442978 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-0d9a5563-05d4-4830-8aeb-47824760f890 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1571 microversion: 2.1 time: 0.171318 Feb 03 03:01:42.453272 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 370/708] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:42 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1571 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 03:01:43.118128 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-cb8ebd7b-89f7-4da2-a706-78068f76fcfb tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:43.118821 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-cb8ebd7b-89f7-4da2-a706-78068f76fcfb tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:43.125816 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-cb8ebd7b-89f7-4da2-a706-78068f76fcfb tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:43.126254 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-cb8ebd7b-89f7-4da2-a706-78068f76fcfb tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:43.127022 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-cb8ebd7b-89f7-4da2-a706-78068f76fcfb tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:43.127452 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-cb8ebd7b-89f7-4da2-a706-78068f76fcfb tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:43.141999 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.wsgi [None req-cb8ebd7b-89f7-4da2-a706-78068f76fcfb tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] HTTP exception thrown: Instance e0708ed4-206d-484e-a2b4-dfb7733d415b could not be found. Feb 03 03:01:43.142592 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-cb8ebd7b-89f7-4da2-a706-78068f76fcfb tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Returning 404 to user: Instance e0708ed4-206d-484e-a2b4-dfb7733d415b could not be found. {{(pid=116385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 03:01:43.143426 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-cb8ebd7b-89f7-4da2-a706-78068f76fcfb tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 404 len: 111 microversion: 2.20 time: 0.029587 Feb 03 03:01:43.143956 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 339/709] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:01:43 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 03 03:01:43.152696 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-d36053f4-6a68-43c5-b770-4eb0bf9028de tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '.version_select at 0x7ff99cfa84c0>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:43.172753 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-d36053f4-6a68-43c5-b770-4eb0bf9028de tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-510769156" status: 204 len: 0 microversion: 2.20 time: 0.023630 Feb 03 03:01:43.173333 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 371/710] 10.222.0.31 () {60 vars in 1258 bytes} [Thu Feb 3 03:01:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-510769156 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 03 03:01:43.459480 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-8eff2dca-fd4c-4746-aa13-15d07a86981b tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:43.460127 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-8eff2dca-fd4c-4746-aa13-15d07a86981b tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:43.466369 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8eff2dca-fd4c-4746-aa13-15d07a86981b tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:43.466804 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8eff2dca-fd4c-4746-aa13-15d07a86981b tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:43.467562 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8eff2dca-fd4c-4746-aa13-15d07a86981b tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:43.467988 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8eff2dca-fd4c-4746-aa13-15d07a86981b tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:43.697199 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-8eff2dca-fd4c-4746-aa13-15d07a86981b tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:43.704748 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-8eff2dca-fd4c-4746-aa13-15d07a86981b tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1571 microversion: 2.1 time: 0.248962 Feb 03 03:01:43.705634 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 340/711] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:43 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1571 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:43.893782 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-f404474e-3e28-428c-a5d1-5cd7516a8b9e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Action: 'create', calling method: .version_select at 0x7ff99cf284c0>, body: {"keypair": {"name": "tempest-keypair-1964776755"}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:01:43.909703 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.quota [None req-f404474e-3e28-428c-a5d1-5cd7516a8b9e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Getting quotas for project e8467ff017574f36b1c31db5579a56ce. Resources: {'key_pairs'} {{(pid=116386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 03:01:43.913645 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.quota [None req-f404474e-3e28-428c-a5d1-5cd7516a8b9e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Getting quotas for user aa4fbbf421f34df6b34b27f3ee5247b1 and project e8467ff017574f36b1c31db5579a56ce. Resources: {'key_pairs'} {{(pid=116386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 03:01:44.063304 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.quota [None req-f404474e-3e28-428c-a5d1-5cd7516a8b9e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Getting quotas for project e8467ff017574f36b1c31db5579a56ce. Resources: {'key_pairs'} {{(pid=116386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 03:01:44.066959 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.quota [None req-f404474e-3e28-428c-a5d1-5cd7516a8b9e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Getting quotas for user aa4fbbf421f34df6b34b27f3ee5247b1 and project e8467ff017574f36b1c31db5579a56ce. Resources: {'key_pairs'} {{(pid=116386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 03:01:44.080806 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-f404474e-3e28-428c-a5d1-5cd7516a8b9e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.190794 Feb 03 03:01:44.081407 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 372/712] 10.222.0.31 () {62 vars in 1198 bytes} [Thu Feb 3 03:01:43 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 192 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 03 03:01:44.721509 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-8b1ddf4a-efa8-48bc-95bf-f45e903125f0 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:44.722086 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-8b1ddf4a-efa8-48bc-95bf-f45e903125f0 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:44.728565 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8b1ddf4a-efa8-48bc-95bf-f45e903125f0 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:44.729030 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8b1ddf4a-efa8-48bc-95bf-f45e903125f0 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:44.729803 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8b1ddf4a-efa8-48bc-95bf-f45e903125f0 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:44.730406 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8b1ddf4a-efa8-48bc-95bf-f45e903125f0 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:44.959773 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-8b1ddf4a-efa8-48bc-95bf-f45e903125f0 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:44.968319 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-8b1ddf4a-efa8-48bc-95bf-f45e903125f0 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1571 microversion: 2.1 time: 0.250429 Feb 03 03:01:44.978292 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 341/713] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:44 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1571 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:45.408490 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-0559bdc6-9fd1-48a8-9718-1fbeb41275b3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2041536249", "imageRef": "99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "17f7ee66-84e4-4ba5-b587-f73d44502290"}], "security_groups": [{"name": "tempest-securitygroup--452681496"}], "key_name": "tempest-keypair-1964776755", "user_data": "}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:01:45.512605 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.network.neutron [None req-0559bdc6-9fd1-48a8-9718-1fbeb41275b3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] validate_networks() for [('17f7ee66-84e4-4ba5-b587-f73d44502290', None, None, None, None, None)] {{(pid=116386) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 03 03:01:45.984934 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-4c20c043-aaaa-46e5-bb89-e3b379c407e5 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:45.985572 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-4c20c043-aaaa-46e5-bb89-e3b379c407e5 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:45.987119 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-0559bdc6-9fd1-48a8-9718-1fbeb41275b3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Flavor limits 0:0:0 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 03 03:01:45.987511 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-0559bdc6-9fd1-48a8-9718-1fbeb41275b3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Image limits 0:0:0 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 03 03:01:45.988238 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-0559bdc6-9fd1-48a8-9718-1fbeb41275b3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Flavor pref 0:0:0 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 03 03:01:45.988676 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-0559bdc6-9fd1-48a8-9718-1fbeb41275b3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Image pref 0:0:0 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 03 03:01:45.989109 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-0559bdc6-9fd1-48a8-9718-1fbeb41275b3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 03 03:01:45.991914 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4c20c043-aaaa-46e5-bb89-e3b379c407e5 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:45.992347 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4c20c043-aaaa-46e5-bb89-e3b379c407e5 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:45.993142 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4c20c043-aaaa-46e5-bb89-e3b379c407e5 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:45.993567 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-4c20c043-aaaa-46e5-bb89-e3b379c407e5 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:45.999041 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0559bdc6-9fd1-48a8-9718-1fbeb41275b3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:45.999487 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0559bdc6-9fd1-48a8-9718-1fbeb41275b3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:46.000289 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0559bdc6-9fd1-48a8-9718-1fbeb41275b3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:46.000746 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0559bdc6-9fd1-48a8-9718-1fbeb41275b3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:46.018701 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.quota [None req-0559bdc6-9fd1-48a8-9718-1fbeb41275b3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Getting quotas for project e8467ff017574f36b1c31db5579a56ce. Resources: {'cores', 'ram', 'instances'} {{(pid=116386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 03:01:46.022884 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.quota [None req-0559bdc6-9fd1-48a8-9718-1fbeb41275b3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Getting quotas for user aa4fbbf421f34df6b34b27f3ee5247b1 and project e8467ff017574f36b1c31db5579a56ce. Resources: {'cores', 'ram', 'instances'} {{(pid=116386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 03:01:46.035994 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-0559bdc6-9fd1-48a8-9718-1fbeb41275b3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Going to run 1 instances... {{(pid=116386) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 03 03:01:46.038750 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-0559bdc6-9fd1-48a8-9718-1fbeb41275b3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 03 03:01:46.091318 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-0559bdc6-9fd1-48a8-9718-1fbeb41275b3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.687570 Feb 03 03:01:46.097097 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 373/714] 10.222.0.31 () {62 vars in 1187 bytes} [Thu Feb 3 03:01:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Feb 03 03:01:46.102447 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-6e1b7ee1-b979-45a5-affc-5295fd74491a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:46.103207 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-6e1b7ee1-b979-45a5-affc-5295fd74491a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:46.134543 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-4c20c043-aaaa-46e5-bb89-e3b379c407e5 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:46.142578 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-4c20c043-aaaa-46e5-bb89-e3b379c407e5 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1571 microversion: 2.1 time: 0.161263 Feb 03 03:01:46.143158 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 342/715] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:45 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1571 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:46.172560 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-6e1b7ee1-b979-45a5-affc-5295fd74491a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:46.180518 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-6e1b7ee1-b979-45a5-affc-5295fd74491a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:46.182114 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-6e1b7ee1-b979-45a5-affc-5295fd74491a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:46.183287 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-6e1b7ee1-b979-45a5-affc-5295fd74491a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1282 microversion: 2.20 time: 0.085045 Feb 03 03:01:46.184381 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 374/716] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:01:46 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1282 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:01:47.159563 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-257626a5-66a4-4c9b-9e08-67fbe3778bd7 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:47.160240 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-257626a5-66a4-4c9b-9e08-67fbe3778bd7 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:47.170290 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-257626a5-66a4-4c9b-9e08-67fbe3778bd7 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:47.170842 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-257626a5-66a4-4c9b-9e08-67fbe3778bd7 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:47.171685 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-257626a5-66a4-4c9b-9e08-67fbe3778bd7 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:47.175416 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-257626a5-66a4-4c9b-9e08-67fbe3778bd7 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:47.201209 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-a36bfc83-b668-4a50-9e38-455d979b22c1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:47.202473 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-a36bfc83-b668-4a50-9e38-455d979b22c1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:47.216033 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a36bfc83-b668-4a50-9e38-455d979b22c1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:47.216794 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a36bfc83-b668-4a50-9e38-455d979b22c1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:47.217745 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a36bfc83-b668-4a50-9e38-455d979b22c1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:47.218328 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a36bfc83-b668-4a50-9e38-455d979b22c1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:47.298786 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-a36bfc83-b668-4a50-9e38-455d979b22c1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:47.309170 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-a36bfc83-b668-4a50-9e38-455d979b22c1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:47.311130 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-a36bfc83-b668-4a50-9e38-455d979b22c1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:47.313514 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-a36bfc83-b668-4a50-9e38-455d979b22c1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1352 microversion: 2.20 time: 0.115127 Feb 03 03:01:47.315128 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 375/717] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:01:47 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1352 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 03 03:01:47.424851 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-257626a5-66a4-4c9b-9e08-67fbe3778bd7 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:47.432781 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-257626a5-66a4-4c9b-9e08-67fbe3778bd7 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1571 microversion: 2.1 time: 0.277020 Feb 03 03:01:47.433345 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 343/718] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:47 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1571 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:48.332505 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-767b0506-59bc-4ca2-a3d3-c9d08ee8e4d5 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:48.333914 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-767b0506-59bc-4ca2-a3d3-c9d08ee8e4d5 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:48.340799 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-767b0506-59bc-4ca2-a3d3-c9d08ee8e4d5 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:48.341190 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-767b0506-59bc-4ca2-a3d3-c9d08ee8e4d5 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:48.341987 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-767b0506-59bc-4ca2-a3d3-c9d08ee8e4d5 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:48.342422 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-767b0506-59bc-4ca2-a3d3-c9d08ee8e4d5 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:48.450389 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-cff459e5-7937-4c65-b104-bda303fb95b3 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:48.451034 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-cff459e5-7937-4c65-b104-bda303fb95b3 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:48.457934 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-cff459e5-7937-4c65-b104-bda303fb95b3 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:48.458377 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-cff459e5-7937-4c65-b104-bda303fb95b3 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:48.459161 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-cff459e5-7937-4c65-b104-bda303fb95b3 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:48.459590 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-cff459e5-7937-4c65-b104-bda303fb95b3 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:48.645966 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-767b0506-59bc-4ca2-a3d3-c9d08ee8e4d5 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:48.654042 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-767b0506-59bc-4ca2-a3d3-c9d08ee8e4d5 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:48.655544 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-767b0506-59bc-4ca2-a3d3-c9d08ee8e4d5 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:48.656635 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-767b0506-59bc-4ca2-a3d3-c9d08ee8e4d5 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1407 microversion: 2.20 time: 0.328068 Feb 03 03:01:48.657216 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 376/719] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:01:48 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1407 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 03 03:01:48.742879 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-cff459e5-7937-4c65-b104-bda303fb95b3 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:48.751093 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-cff459e5-7937-4c65-b104-bda303fb95b3 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1571 microversion: 2.1 time: 0.304739 Feb 03 03:01:48.762377 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 344/720] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:48 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1571 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:48.853453 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-54c2d35b-1fd6-4a9f-ae51-79c64a1c4f1c req-c2a8eade-e51d-4972-ab4c-34189368f9c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d795a9-10f4-4812-9284-3b056987c2b4", "tag": "b31cace4-7041-409f-a805-55308777e17a"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:01:48.854795 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:01:48.854795 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 03:01:48.871427 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-54c2d35b-1fd6-4a9f-ae51-79c64a1c4f1c req-c2a8eade-e51d-4972-ab4c-34189368f9c8 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:48.872008 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-54c2d35b-1fd6-4a9f-ae51-79c64a1c4f1c req-c2a8eade-e51d-4972-ab4c-34189368f9c8 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:48.910574 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-54c2d35b-1fd6-4a9f-ae51-79c64a1c4f1c req-c2a8eade-e51d-4972-ab4c-34189368f9c8 service nova] Creating event network-changed:b31cace4-7041-409f-a805-55308777e17a for instance 26d795a9-10f4-4812-9284-3b056987c2b4 on hv-cinder-82758 Feb 03 03:01:48.922779 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-54c2d35b-1fd6-4a9f-ae51-79c64a1c4f1c req-c2a8eade-e51d-4972-ab4c-34189368f9c8 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074972 Feb 03 03:01:48.923442 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 377/721] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:01:49.007638 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-49568950-c0e1-4cca-9e22-50183e838736 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:49.008890 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-49568950-c0e1-4cca-9e22-50183e838736 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:49.015010 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-49568950-c0e1-4cca-9e22-50183e838736 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:49.015733 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-49568950-c0e1-4cca-9e22-50183e838736 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:49.016623 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-49568950-c0e1-4cca-9e22-50183e838736 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:49.017237 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-49568950-c0e1-4cca-9e22-50183e838736 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:49.048547 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-49568950-c0e1-4cca-9e22-50183e838736 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044563 Feb 03 03:01:49.049146 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 345/722] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Feb 3 03:01:49 2022] GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:01:49.675460 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-385d0336-f8b6-48c1-bacd-aea97f868e71 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:49.676220 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-385d0336-f8b6-48c1-bacd-aea97f868e71 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:49.682738 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-385d0336-f8b6-48c1-bacd-aea97f868e71 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:49.683181 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-385d0336-f8b6-48c1-bacd-aea97f868e71 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:49.683952 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-385d0336-f8b6-48c1-bacd-aea97f868e71 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:49.684376 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-385d0336-f8b6-48c1-bacd-aea97f868e71 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:49.768752 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-7f851126-2f38-4e54-9385-777dd409266b tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:49.769371 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-7f851126-2f38-4e54-9385-777dd409266b tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:49.776052 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7f851126-2f38-4e54-9385-777dd409266b tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:49.776490 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7f851126-2f38-4e54-9385-777dd409266b tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:49.777323 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7f851126-2f38-4e54-9385-777dd409266b tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:49.777750 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7f851126-2f38-4e54-9385-777dd409266b tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:49.851132 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-385d0336-f8b6-48c1-bacd-aea97f868e71 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:49.859031 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-385d0336-f8b6-48c1-bacd-aea97f868e71 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:49.860499 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-385d0336-f8b6-48c1-bacd-aea97f868e71 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:49.861616 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-385d0336-f8b6-48c1-bacd-aea97f868e71 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1407 microversion: 2.20 time: 0.190928 Feb 03 03:01:49.862173 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 378/723] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:01:49 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:01:49.940375 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-7f851126-2f38-4e54-9385-777dd409266b tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:49.952418 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-7f851126-2f38-4e54-9385-777dd409266b tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1571 microversion: 2.1 time: 0.187157 Feb 03 03:01:49.953373 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 346/724] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:49 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1571 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:50.888756 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-45353f7d-5fdb-4808-9602-55bcc9a8abb7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:50.889818 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-45353f7d-5fdb-4808-9602-55bcc9a8abb7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:50.899957 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-45353f7d-5fdb-4808-9602-55bcc9a8abb7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:50.900408 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-45353f7d-5fdb-4808-9602-55bcc9a8abb7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:50.901243 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-45353f7d-5fdb-4808-9602-55bcc9a8abb7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:50.901674 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-45353f7d-5fdb-4808-9602-55bcc9a8abb7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:50.971335 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-564c6edc-8fe1-4e77-b4a7-faa5dbcad810 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:50.972000 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-564c6edc-8fe1-4e77-b4a7-faa5dbcad810 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:50.978979 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-564c6edc-8fe1-4e77-b4a7-faa5dbcad810 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:50.979425 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-564c6edc-8fe1-4e77-b4a7-faa5dbcad810 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:50.980208 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-564c6edc-8fe1-4e77-b4a7-faa5dbcad810 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:50.980645 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-564c6edc-8fe1-4e77-b4a7-faa5dbcad810 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:51.074077 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-45353f7d-5fdb-4808-9602-55bcc9a8abb7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:51.082189 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-45353f7d-5fdb-4808-9602-55bcc9a8abb7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:51.083683 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-45353f7d-5fdb-4808-9602-55bcc9a8abb7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:51.084781 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-45353f7d-5fdb-4808-9602-55bcc9a8abb7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1407 microversion: 2.20 time: 0.202247 Feb 03 03:01:51.085346 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 379/725] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:01:50 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:01:51.140205 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-564c6edc-8fe1-4e77-b4a7-faa5dbcad810 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:51.148509 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-564c6edc-8fe1-4e77-b4a7-faa5dbcad810 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1571 microversion: 2.1 time: 0.180885 Feb 03 03:01:51.149117 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 347/726] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:50 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1571 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:52.103267 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-6d921b84-b8ea-444c-be8f-0abe52b438dd tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:52.103858 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-6d921b84-b8ea-444c-be8f-0abe52b438dd tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:52.110840 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6d921b84-b8ea-444c-be8f-0abe52b438dd tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:52.111261 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6d921b84-b8ea-444c-be8f-0abe52b438dd tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:52.112068 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6d921b84-b8ea-444c-be8f-0abe52b438dd tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:52.112498 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6d921b84-b8ea-444c-be8f-0abe52b438dd tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:52.171155 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-6ba51e43-0629-45d8-b4a9-d03eaaa7ee36 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:52.171747 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-6ba51e43-0629-45d8-b4a9-d03eaaa7ee36 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:52.178327 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6ba51e43-0629-45d8-b4a9-d03eaaa7ee36 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:52.178781 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6ba51e43-0629-45d8-b4a9-d03eaaa7ee36 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:52.179554 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6ba51e43-0629-45d8-b4a9-d03eaaa7ee36 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:52.179982 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6ba51e43-0629-45d8-b4a9-d03eaaa7ee36 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:52.273103 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-6d921b84-b8ea-444c-be8f-0abe52b438dd tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:52.281312 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-6d921b84-b8ea-444c-be8f-0abe52b438dd tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:52.282900 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-6d921b84-b8ea-444c-be8f-0abe52b438dd tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:52.284081 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-6d921b84-b8ea-444c-be8f-0abe52b438dd tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1407 microversion: 2.20 time: 0.184569 Feb 03 03:01:52.285797 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 380/727] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:01:52 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:01:52.353917 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-6ba51e43-0629-45d8-b4a9-d03eaaa7ee36 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:52.364307 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-6ba51e43-0629-45d8-b4a9-d03eaaa7ee36 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1571 microversion: 2.1 time: 0.196993 Feb 03 03:01:52.365127 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 348/728] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:52 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1571 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:53.307353 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-213023de-2b6a-4dd6-9d71-c66d333eb1cc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:53.308270 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-213023de-2b6a-4dd6-9d71-c66d333eb1cc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:53.319088 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-213023de-2b6a-4dd6-9d71-c66d333eb1cc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:53.319831 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-213023de-2b6a-4dd6-9d71-c66d333eb1cc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:53.321163 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-213023de-2b6a-4dd6-9d71-c66d333eb1cc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:53.321883 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-213023de-2b6a-4dd6-9d71-c66d333eb1cc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:53.382532 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-2ca492ef-6644-4ed9-8059-acf3d071ba9a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:53.383108 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-2ca492ef-6644-4ed9-8059-acf3d071ba9a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:53.389653 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2ca492ef-6644-4ed9-8059-acf3d071ba9a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:53.390089 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2ca492ef-6644-4ed9-8059-acf3d071ba9a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:53.390851 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2ca492ef-6644-4ed9-8059-acf3d071ba9a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:53.391272 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2ca492ef-6644-4ed9-8059-acf3d071ba9a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:53.483590 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-213023de-2b6a-4dd6-9d71-c66d333eb1cc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:53.491445 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-213023de-2b6a-4dd6-9d71-c66d333eb1cc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:53.492958 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-213023de-2b6a-4dd6-9d71-c66d333eb1cc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:53.494070 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-213023de-2b6a-4dd6-9d71-c66d333eb1cc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1407 microversion: 2.20 time: 0.192987 Feb 03 03:01:53.494628 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 381/729] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:01:53 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:01:53.550063 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-2ca492ef-6644-4ed9-8059-acf3d071ba9a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:53.558036 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-2ca492ef-6644-4ed9-8059-acf3d071ba9a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1571 microversion: 2.1 time: 0.179423 Feb 03 03:01:53.558614 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 349/730] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:53 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1571 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 03:01:54.515265 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-e563dd80-d4a6-49f6-a822-6f7bf3e15f58 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:54.516210 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-e563dd80-d4a6-49f6-a822-6f7bf3e15f58 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:54.526768 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e563dd80-d4a6-49f6-a822-6f7bf3e15f58 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:54.527500 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e563dd80-d4a6-49f6-a822-6f7bf3e15f58 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:54.528727 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e563dd80-d4a6-49f6-a822-6f7bf3e15f58 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:54.529151 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e563dd80-d4a6-49f6-a822-6f7bf3e15f58 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:54.575254 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-c9ea5503-80ab-4279-a0bb-02fafefaa10b tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:54.575822 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-c9ea5503-80ab-4279-a0bb-02fafefaa10b tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:54.582971 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c9ea5503-80ab-4279-a0bb-02fafefaa10b tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:54.583455 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c9ea5503-80ab-4279-a0bb-02fafefaa10b tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:54.584256 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c9ea5503-80ab-4279-a0bb-02fafefaa10b tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:54.584762 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c9ea5503-80ab-4279-a0bb-02fafefaa10b tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:54.690067 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-e563dd80-d4a6-49f6-a822-6f7bf3e15f58 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:54.698554 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-e563dd80-d4a6-49f6-a822-6f7bf3e15f58 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:54.700164 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-e563dd80-d4a6-49f6-a822-6f7bf3e15f58 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:54.701284 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-e563dd80-d4a6-49f6-a822-6f7bf3e15f58 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1407 microversion: 2.20 time: 0.192369 Feb 03 03:01:54.701810 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 382/731] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:01:54 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:01:54.748061 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-c9ea5503-80ab-4279-a0bb-02fafefaa10b tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:54.756372 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-c9ea5503-80ab-4279-a0bb-02fafefaa10b tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1571 microversion: 2.1 time: 0.184834 Feb 03 03:01:54.756981 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 350/732] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:54 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1571 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:55.719180 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-decbe16c-7020-4834-8a22-64323dcfe1e1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:55.719783 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-decbe16c-7020-4834-8a22-64323dcfe1e1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:55.726668 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-decbe16c-7020-4834-8a22-64323dcfe1e1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:55.727113 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-decbe16c-7020-4834-8a22-64323dcfe1e1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:55.727894 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-decbe16c-7020-4834-8a22-64323dcfe1e1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:55.728325 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-decbe16c-7020-4834-8a22-64323dcfe1e1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:55.774803 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-656db055-3251-47de-bc23-c8daa89be7df tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:55.775633 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-656db055-3251-47de-bc23-c8daa89be7df tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:55.782337 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-656db055-3251-47de-bc23-c8daa89be7df tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:55.782875 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-656db055-3251-47de-bc23-c8daa89be7df tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:55.783722 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-656db055-3251-47de-bc23-c8daa89be7df tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:55.784227 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-656db055-3251-47de-bc23-c8daa89be7df tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:55.895384 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-decbe16c-7020-4834-8a22-64323dcfe1e1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:55.903730 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-decbe16c-7020-4834-8a22-64323dcfe1e1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:55.905291 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-decbe16c-7020-4834-8a22-64323dcfe1e1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:55.906395 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-decbe16c-7020-4834-8a22-64323dcfe1e1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1407 microversion: 2.20 time: 0.190973 Feb 03 03:01:55.907206 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 383/733] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:01:55 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:01:55.963075 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-656db055-3251-47de-bc23-c8daa89be7df tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:55.970885 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-656db055-3251-47de-bc23-c8daa89be7df tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1571 microversion: 2.1 time: 0.200876 Feb 03 03:01:55.971641 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 351/734] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:55 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1571 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:56.924366 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-cc953d3c-32bd-4c8b-afdd-f1867853f89d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:56.925355 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-cc953d3c-32bd-4c8b-afdd-f1867853f89d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:56.932001 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cc953d3c-32bd-4c8b-afdd-f1867853f89d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:56.932493 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cc953d3c-32bd-4c8b-afdd-f1867853f89d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:56.933603 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cc953d3c-32bd-4c8b-afdd-f1867853f89d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:56.933998 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cc953d3c-32bd-4c8b-afdd-f1867853f89d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:56.988122 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-98fd6499-1b24-488e-8102-95805fa1d6d2 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:56.988750 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-98fd6499-1b24-488e-8102-95805fa1d6d2 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:56.995825 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-98fd6499-1b24-488e-8102-95805fa1d6d2 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:56.996407 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-98fd6499-1b24-488e-8102-95805fa1d6d2 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:56.997649 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-98fd6499-1b24-488e-8102-95805fa1d6d2 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:56.998106 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-98fd6499-1b24-488e-8102-95805fa1d6d2 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:57.243545 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-cc953d3c-32bd-4c8b-afdd-f1867853f89d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:57.257045 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-cc953d3c-32bd-4c8b-afdd-f1867853f89d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:57.259345 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-cc953d3c-32bd-4c8b-afdd-f1867853f89d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:57.261457 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-cc953d3c-32bd-4c8b-afdd-f1867853f89d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1407 microversion: 2.20 time: 0.340433 Feb 03 03:01:57.262329 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 384/735] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:01:56 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1407 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:01:57.304106 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-98fd6499-1b24-488e-8102-95805fa1d6d2 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:57.312252 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-98fd6499-1b24-488e-8102-95805fa1d6d2 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1571 microversion: 2.1 time: 0.328501 Feb 03 03:01:57.321876 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 352/736] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:56 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1571 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:57.382727 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-3d75eeef-f819-4f3d-bb84-b11d917a4020 req-28484c94-b2ed-4214-98c6-f4d1297fb6f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d795a9-10f4-4812-9284-3b056987c2b4", "name": "network-vif-plugged", "status": "completed", "tag": "b31cace4-7041-409f-a805-55308777e17a"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:01:57.385127 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:01:57.385127 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 03:01:57.396485 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-3d75eeef-f819-4f3d-bb84-b11d917a4020 req-28484c94-b2ed-4214-98c6-f4d1297fb6f7 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:57.397121 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-3d75eeef-f819-4f3d-bb84-b11d917a4020 req-28484c94-b2ed-4214-98c6-f4d1297fb6f7 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:57.414119 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-3d75eeef-f819-4f3d-bb84-b11d917a4020 req-28484c94-b2ed-4214-98c6-f4d1297fb6f7 service nova] Creating event network-vif-plugged:b31cace4-7041-409f-a805-55308777e17a for instance 26d795a9-10f4-4812-9284-3b056987c2b4 on hv-cinder-82758 Feb 03 03:01:57.420422 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-3d75eeef-f819-4f3d-bb84-b11d917a4020 req-28484c94-b2ed-4214-98c6-f4d1297fb6f7 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041115 Feb 03 03:01:57.421784 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 385/737] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:01:58.279654 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-1c4f865d-e3ec-49ee-8ac7-509bd036f4e3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:58.280215 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-1c4f865d-e3ec-49ee-8ac7-509bd036f4e3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:58.286704 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1c4f865d-e3ec-49ee-8ac7-509bd036f4e3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:58.287138 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1c4f865d-e3ec-49ee-8ac7-509bd036f4e3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:58.287898 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1c4f865d-e3ec-49ee-8ac7-509bd036f4e3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:58.288317 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1c4f865d-e3ec-49ee-8ac7-509bd036f4e3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:58.333404 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-e791a7bb-178b-4504-8ca5-4d9631662684 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:58.334954 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-e791a7bb-178b-4504-8ca5-4d9631662684 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:58.342026 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e791a7bb-178b-4504-8ca5-4d9631662684 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:58.342699 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e791a7bb-178b-4504-8ca5-4d9631662684 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:58.343511 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e791a7bb-178b-4504-8ca5-4d9631662684 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:58.343945 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e791a7bb-178b-4504-8ca5-4d9631662684 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:58.463250 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-1c4f865d-e3ec-49ee-8ac7-509bd036f4e3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:58.471849 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-1c4f865d-e3ec-49ee-8ac7-509bd036f4e3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:58.473831 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-1c4f865d-e3ec-49ee-8ac7-509bd036f4e3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:58.475023 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-1c4f865d-e3ec-49ee-8ac7-509bd036f4e3 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1407 microversion: 2.20 time: 0.199370 Feb 03 03:01:58.475662 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 353/738] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:01:58 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:01:58.532183 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-e791a7bb-178b-4504-8ca5-4d9631662684 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:58.544940 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-e791a7bb-178b-4504-8ca5-4d9631662684 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1571 microversion: 2.1 time: 0.215985 Feb 03 03:01:58.545271 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 386/739] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:58 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1571 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 03:01:59.493477 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-378e27cf-6ce6-45de-bc4d-376f2a8bf9cb tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:59.494678 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-378e27cf-6ce6-45de-bc4d-376f2a8bf9cb tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:59.512925 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-378e27cf-6ce6-45de-bc4d-376f2a8bf9cb tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:59.513068 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-378e27cf-6ce6-45de-bc4d-376f2a8bf9cb tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:59.514165 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-378e27cf-6ce6-45de-bc4d-376f2a8bf9cb tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:59.514717 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-378e27cf-6ce6-45de-bc4d-376f2a8bf9cb tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:59.561561 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-8b89ee09-8918-49b0-aa7b-5c705a216411 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:59.563176 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-8b89ee09-8918-49b0-aa7b-5c705a216411 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:59.582126 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8b89ee09-8918-49b0-aa7b-5c705a216411 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:59.589413 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8b89ee09-8918-49b0-aa7b-5c705a216411 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:59.590197 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8b89ee09-8918-49b0-aa7b-5c705a216411 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:59.590878 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8b89ee09-8918-49b0-aa7b-5c705a216411 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:59.759361 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-378e27cf-6ce6-45de-bc4d-376f2a8bf9cb tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:59.783058 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-378e27cf-6ce6-45de-bc4d-376f2a8bf9cb tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:59.785865 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-378e27cf-6ce6-45de-bc4d-376f2a8bf9cb tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:59.789524 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-378e27cf-6ce6-45de-bc4d-376f2a8bf9cb tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1599 microversion: 2.20 time: 0.300487 Feb 03 03:01:59.791014 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 354/740] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:01:59 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1599 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:01:59.814767 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-48993246-dbd2-43ce-8ea9-f8f21e9d290f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:01:59.815618 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-48993246-dbd2-43ce-8ea9-f8f21e9d290f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:01:59.824053 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-48993246-dbd2-43ce-8ea9-f8f21e9d290f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:59.824924 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-48993246-dbd2-43ce-8ea9-f8f21e9d290f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:59.826551 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-48993246-dbd2-43ce-8ea9-f8f21e9d290f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:01:59.827311 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-48993246-dbd2-43ce-8ea9-f8f21e9d290f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:01:59.869933 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-8b89ee09-8918-49b0-aa7b-5c705a216411 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:01:59.878389 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-8b89ee09-8918-49b0-aa7b-5c705a216411 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1571 microversion: 2.1 time: 0.320380 Feb 03 03:01:59.878993 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 387/741] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:01:59 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1571 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:01:59.985607 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-48993246-dbd2-43ce-8ea9-f8f21e9d290f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.175207 Feb 03 03:01:59.992989 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 355/742] 10.222.0.31 () {60 vars in 1315 bytes} [Thu Feb 3 03:01:59 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4/os-interface => generated 285 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 03 03:02:00.895541 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-6160ff19-b046-435a-b7b5-267221748c2f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:00.896154 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-6160ff19-b046-435a-b7b5-267221748c2f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:00.906529 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6160ff19-b046-435a-b7b5-267221748c2f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:00.907092 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6160ff19-b046-435a-b7b5-267221748c2f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:00.907964 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6160ff19-b046-435a-b7b5-267221748c2f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:00.908413 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6160ff19-b046-435a-b7b5-267221748c2f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:01.195333 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-6160ff19-b046-435a-b7b5-267221748c2f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:01.206672 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-6160ff19-b046-435a-b7b5-267221748c2f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1512 microversion: 2.1 time: 0.314843 Feb 03 03:02:01.207265 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 388/743] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:00 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1512 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:01.223548 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-91f7da0b-b414-43d2-a3f4-54ebf871a5d4 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:02:01.224142 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-91f7da0b-b414-43d2-a3f4-54ebf871a5d4 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:01.230706 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-91f7da0b-b414-43d2-a3f4-54ebf871a5d4 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:01.231424 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-91f7da0b-b414-43d2-a3f4-54ebf871a5d4 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:01.232554 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-91f7da0b-b414-43d2-a3f4-54ebf871a5d4 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:01.233153 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-91f7da0b-b414-43d2-a3f4-54ebf871a5d4 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:01.489176 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-fea883e9-67d3-48ee-8eac-db189200126e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:01.489695 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-fea883e9-67d3-48ee-8eac-db189200126e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:01.499740 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fea883e9-67d3-48ee-8eac-db189200126e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:01.501008 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fea883e9-67d3-48ee-8eac-db189200126e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:01.515623 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fea883e9-67d3-48ee-8eac-db189200126e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:01.517579 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fea883e9-67d3-48ee-8eac-db189200126e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:01.620914 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-91f7da0b-b414-43d2-a3f4-54ebf871a5d4 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "POST /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5/action" status: 202 len: 0 microversion: 2.1 time: 0.401027 Feb 03 03:02:01.625829 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 356/744] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Feb 3 03:02:01 2022] POST /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 03 03:02:01.807790 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-fea883e9-67d3-48ee-8eac-db189200126e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:01.816788 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-fea883e9-67d3-48ee-8eac-db189200126e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:01.818630 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-fea883e9-67d3-48ee-8eac-db189200126e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:01.819999 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-fea883e9-67d3-48ee-8eac-db189200126e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1599 microversion: 2.20 time: 0.335795 Feb 03 03:02:01.820773 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 389/745] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:02:01 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1599 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:02:01.836428 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-3fe5be54-3918-46f6-8ee0-7a90549388ab tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:01.843647 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-3fe5be54-3918-46f6-8ee0-7a90549388ab tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:01.855969 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3fe5be54-3918-46f6-8ee0-7a90549388ab tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:01.856887 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3fe5be54-3918-46f6-8ee0-7a90549388ab tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:01.857985 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3fe5be54-3918-46f6-8ee0-7a90549388ab tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:01.858515 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3fe5be54-3918-46f6-8ee0-7a90549388ab tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:01.916440 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-60561d9a-ef75-4fd0-b021-5b396f0052cb req-9aace784-cdec-42c4-b6ee-c7be8fad28bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d795a9-10f4-4812-9284-3b056987c2b4", "tag": "b31cace4-7041-409f-a805-55308777e17a"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:02:01.918124 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:02:01.918124 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:02:01.931456 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-60561d9a-ef75-4fd0-b021-5b396f0052cb req-9aace784-cdec-42c4-b6ee-c7be8fad28bd service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:01.931897 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-60561d9a-ef75-4fd0-b021-5b396f0052cb req-9aace784-cdec-42c4-b6ee-c7be8fad28bd service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:01.944110 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-60561d9a-ef75-4fd0-b021-5b396f0052cb req-9aace784-cdec-42c4-b6ee-c7be8fad28bd service nova] Creating event network-changed:b31cace4-7041-409f-a805-55308777e17a for instance 26d795a9-10f4-4812-9284-3b056987c2b4 on hv-cinder-82758 Feb 03 03:02:01.950568 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-60561d9a-ef75-4fd0-b021-5b396f0052cb req-9aace784-cdec-42c4-b6ee-c7be8fad28bd service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.320708 Feb 03 03:02:01.951749 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 357/746] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:02:02.240313 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-3fe5be54-3918-46f6-8ee0-7a90549388ab tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:02.249026 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-3fe5be54-3918-46f6-8ee0-7a90549388ab tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1520 microversion: 2.1 time: 0.426909 Feb 03 03:02:02.249611 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 390/747] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:01 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1520 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:02.840409 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-09468124-094f-452c-85d1-7ef3b4124e61 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:02.842565 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-09468124-094f-452c-85d1-7ef3b4124e61 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:02.855552 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-09468124-094f-452c-85d1-7ef3b4124e61 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:02.856625 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-09468124-094f-452c-85d1-7ef3b4124e61 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:02.860850 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-09468124-094f-452c-85d1-7ef3b4124e61 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:02.861528 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-09468124-094f-452c-85d1-7ef3b4124e61 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:03.104299 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-09468124-094f-452c-85d1-7ef3b4124e61 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:03.114512 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-09468124-094f-452c-85d1-7ef3b4124e61 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:03.116155 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-09468124-094f-452c-85d1-7ef3b4124e61 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:03.117644 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-09468124-094f-452c-85d1-7ef3b4124e61 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1599 microversion: 2.20 time: 0.281897 Feb 03 03:02:03.118850 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 358/748] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:02:02 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1599 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:02:03.270683 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-9dafde01-4c2b-4299-8b79-b4cc31a09bda tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:03.272400 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-9dafde01-4c2b-4299-8b79-b4cc31a09bda tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:03.285008 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-9dafde01-4c2b-4299-8b79-b4cc31a09bda tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:03.285840 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-9dafde01-4c2b-4299-8b79-b4cc31a09bda tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:03.286878 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-9dafde01-4c2b-4299-8b79-b4cc31a09bda tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:03.287885 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-9dafde01-4c2b-4299-8b79-b4cc31a09bda tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:03.309593 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-7aa59e33-78d1-4239-b8bd-b51d340e75d8 req-40dd028e-7b66-4fe7-aadc-ec3c36a6ad69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a23dfa-b676-4e5a-b50a-126b1edd49e5", "name": "network-vif-unplugged", "status": "completed", "tag": "e9d2989c-2c82-4969-8caa-45dce6105669"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:02:03.313176 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:02:03.313176 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:02:03.328284 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-7aa59e33-78d1-4239-b8bd-b51d340e75d8 req-40dd028e-7b66-4fe7-aadc-ec3c36a6ad69 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:03.329103 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-7aa59e33-78d1-4239-b8bd-b51d340e75d8 req-40dd028e-7b66-4fe7-aadc-ec3c36a6ad69 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:03.372615 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.compute.server_external_events [req-7aa59e33-78d1-4239-b8bd-b51d340e75d8 req-40dd028e-7b66-4fe7-aadc-ec3c36a6ad69 service nova] Unable to find a host for instance 76a23dfa-b676-4e5a-b50a-126b1edd49e5. Dropping event network-vif-unplugged {{(pid=116385) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 03 03:02:03.374370 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-7aa59e33-78d1-4239-b8bd-b51d340e75d8 req-40dd028e-7b66-4fe7-aadc-ec3c36a6ad69 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.070069 Feb 03 03:02:03.375250 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 359/749] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 72 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 03 03:02:03.497383 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-9dafde01-4c2b-4299-8b79-b4cc31a09bda tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:03.507878 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-9dafde01-4c2b-4299-8b79-b4cc31a09bda tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1522 microversion: 2.1 time: 0.244048 Feb 03 03:02:03.509047 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 391/750] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:03 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:04.138947 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-6f5edb74-db1d-418b-919e-e91b962bb56c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:04.141008 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-6f5edb74-db1d-418b-919e-e91b962bb56c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:04.153177 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6f5edb74-db1d-418b-919e-e91b962bb56c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:04.153623 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6f5edb74-db1d-418b-919e-e91b962bb56c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:04.154417 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6f5edb74-db1d-418b-919e-e91b962bb56c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:04.155024 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6f5edb74-db1d-418b-919e-e91b962bb56c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:04.396523 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-6f5edb74-db1d-418b-919e-e91b962bb56c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:04.407757 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-6f5edb74-db1d-418b-919e-e91b962bb56c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:04.409764 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-6f5edb74-db1d-418b-919e-e91b962bb56c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:04.411131 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-6f5edb74-db1d-418b-919e-e91b962bb56c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1718 microversion: 2.20 time: 0.277436 Feb 03 03:02:04.412178 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 360/751] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:02:04 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1718 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:02:04.428154 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-746db71f-02cb-4fe2-86d4-d707e0fa9ffe tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:04.429339 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-746db71f-02cb-4fe2-86d4-d707e0fa9ffe tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:04.439164 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-746db71f-02cb-4fe2-86d4-d707e0fa9ffe tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:04.439604 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-746db71f-02cb-4fe2-86d4-d707e0fa9ffe tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:04.442680 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-746db71f-02cb-4fe2-86d4-d707e0fa9ffe tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:04.443289 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-746db71f-02cb-4fe2-86d4-d707e0fa9ffe tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:04.473067 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-746db71f-02cb-4fe2-86d4-d707e0fa9ffe tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4/ips" status: 200 len: 152 microversion: 2.20 time: 0.047986 Feb 03 03:02:04.490871 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 392/752] 10.222.0.31 () {60 vars in 1288 bytes} [Thu Feb 3 03:02:04 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4/ips => generated 152 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 03 03:02:04.525747 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-920b1b52-d492-4647-9860-9828e6e1141d tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:04.526356 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-920b1b52-d492-4647-9860-9828e6e1141d tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:04.533336 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-920b1b52-d492-4647-9860-9828e6e1141d tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:04.533681 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-920b1b52-d492-4647-9860-9828e6e1141d tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:04.534485 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-920b1b52-d492-4647-9860-9828e6e1141d tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:04.535015 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-920b1b52-d492-4647-9860-9828e6e1141d tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:04.883254 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-920b1b52-d492-4647-9860-9828e6e1141d tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:04.892904 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-920b1b52-d492-4647-9860-9828e6e1141d tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1578 microversion: 2.1 time: 0.370643 Feb 03 03:02:04.894097 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 361/753] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:04 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1578 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:05.910253 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-b0f8cd78-86d7-470d-8ca0-27b5c7d731f7 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:05.911841 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-b0f8cd78-86d7-470d-8ca0-27b5c7d731f7 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:05.921710 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b0f8cd78-86d7-470d-8ca0-27b5c7d731f7 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:05.925201 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b0f8cd78-86d7-470d-8ca0-27b5c7d731f7 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:05.926682 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b0f8cd78-86d7-470d-8ca0-27b5c7d731f7 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:05.928015 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b0f8cd78-86d7-470d-8ca0-27b5c7d731f7 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:06.198703 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-b0f8cd78-86d7-470d-8ca0-27b5c7d731f7 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:06.216480 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-b0f8cd78-86d7-470d-8ca0-27b5c7d731f7 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1578 microversion: 2.1 time: 0.309862 Feb 03 03:02:06.228594 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 393/754] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:05 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1578 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:07.032832 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-529f0e5c-1bc1-41bd-a8ce-3712c0ad9a2c tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Action: 'create', calling method: .version_select at 0x7ff99cf3b1f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1043137288"}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:02:07.046421 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-529f0e5c-1bc1-41bd-a8ce-3712c0ad9a2c tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Getting quotas for project 264ee2f5b580483c85a302041b05c23f. Resources: {'key_pairs'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 03:02:07.050162 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-529f0e5c-1bc1-41bd-a8ce-3712c0ad9a2c tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Getting quotas for user 6a97115409ba4be989f9071c61df79a5 and project 264ee2f5b580483c85a302041b05c23f. Resources: {'key_pairs'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 03:02:07.234516 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-a49a66e1-5ba2-4756-bba4-a12ed77add2c tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:07.235300 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-a49a66e1-5ba2-4756-bba4-a12ed77add2c tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:07.241927 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a49a66e1-5ba2-4756-bba4-a12ed77add2c tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:07.242508 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a49a66e1-5ba2-4756-bba4-a12ed77add2c tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:07.243387 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a49a66e1-5ba2-4756-bba4-a12ed77add2c tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:07.243919 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a49a66e1-5ba2-4756-bba4-a12ed77add2c tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:07.383987 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-a49a66e1-5ba2-4756-bba4-a12ed77add2c tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:07.392060 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-a49a66e1-5ba2-4756-bba4-a12ed77add2c tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1578 microversion: 2.1 time: 0.161321 Feb 03 03:02:07.393004 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 394/755] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:07 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:07.444643 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-529f0e5c-1bc1-41bd-a8ce-3712c0ad9a2c tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Getting quotas for project 264ee2f5b580483c85a302041b05c23f. Resources: {'key_pairs'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 03:02:07.448297 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-529f0e5c-1bc1-41bd-a8ce-3712c0ad9a2c tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Getting quotas for user 6a97115409ba4be989f9071c61df79a5 and project 264ee2f5b580483c85a302041b05c23f. Resources: {'key_pairs'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 03:02:07.461150 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-529f0e5c-1bc1-41bd-a8ce-3712c0ad9a2c tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.526654 Feb 03 03:02:07.461754 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 362/756] 10.222.0.31 () {60 vars in 1157 bytes} [Thu Feb 3 03:02:06 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:08.409480 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-6c637147-ffb8-4339-83ff-19e0be95ca29 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:08.410119 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-6c637147-ffb8-4339-83ff-19e0be95ca29 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:08.416618 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6c637147-ffb8-4339-83ff-19e0be95ca29 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:08.417096 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6c637147-ffb8-4339-83ff-19e0be95ca29 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:08.417969 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6c637147-ffb8-4339-83ff-19e0be95ca29 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:08.418445 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6c637147-ffb8-4339-83ff-19e0be95ca29 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:08.563091 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-6c637147-ffb8-4339-83ff-19e0be95ca29 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:08.570640 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-6c637147-ffb8-4339-83ff-19e0be95ca29 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1578 microversion: 2.1 time: 0.164912 Feb 03 03:02:08.571185 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 395/757] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:08 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:09.587893 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-50587ea8-8a71-458f-9cb8-61d59f39d7da tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:09.588621 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-50587ea8-8a71-458f-9cb8-61d59f39d7da tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:09.597175 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-50587ea8-8a71-458f-9cb8-61d59f39d7da tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:09.598015 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-50587ea8-8a71-458f-9cb8-61d59f39d7da tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:09.598797 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-50587ea8-8a71-458f-9cb8-61d59f39d7da tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:09.599219 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-50587ea8-8a71-458f-9cb8-61d59f39d7da tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:09.752219 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-50587ea8-8a71-458f-9cb8-61d59f39d7da tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:09.760702 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-50587ea8-8a71-458f-9cb8-61d59f39d7da tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1578 microversion: 2.1 time: 0.176973 Feb 03 03:02:09.761998 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 363/758] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:09 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1578 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:10.777756 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-8bf7cdf5-e582-423e-858b-b57327062a62 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:10.778605 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-8bf7cdf5-e582-423e-858b-b57327062a62 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:10.785102 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8bf7cdf5-e582-423e-858b-b57327062a62 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:10.785547 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8bf7cdf5-e582-423e-858b-b57327062a62 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:10.786369 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8bf7cdf5-e582-423e-858b-b57327062a62 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:10.786796 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8bf7cdf5-e582-423e-858b-b57327062a62 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:10.943185 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-8bf7cdf5-e582-423e-858b-b57327062a62 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:10.953564 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-8bf7cdf5-e582-423e-858b-b57327062a62 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1578 microversion: 2.1 time: 0.179886 Feb 03 03:02:10.954155 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 396/759] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:10 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1578 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:11.570503 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-df0136f4-5bdb-4693-9fb7-39f5a8c3f7cc tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:11.571022 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-df0136f4-5bdb-4693-9fb7-39f5a8c3f7cc tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:11.578002 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-df0136f4-5bdb-4693-9fb7-39f5a8c3f7cc tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:11.578452 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-df0136f4-5bdb-4693-9fb7-39f5a8c3f7cc tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:11.579244 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-df0136f4-5bdb-4693-9fb7-39f5a8c3f7cc tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:11.579663 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-df0136f4-5bdb-4693-9fb7-39f5a8c3f7cc tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:11.612059 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-df0136f4-5bdb-4693-9fb7-39f5a8c3f7cc tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f/os-volume_attachments/002805bd-443b-41f5-810b-3daa4c4a0d97" status: 200 len: 194 microversion: 2.1 time: 0.045318 Feb 03 03:02:11.616919 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 364/760] 10.222.0.31 () {58 vars in 1412 bytes} [Thu Feb 3 03:02:11 2022] GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f/os-volume_attachments/002805bd-443b-41f5-810b-3daa4c4a0d97 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:02:11.626295 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-7d621dc8-84da-40b2-b134-51844ab26006 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:11.626829 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-7d621dc8-84da-40b2-b134-51844ab26006 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:11.633537 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7d621dc8-84da-40b2-b134-51844ab26006 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:11.634011 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7d621dc8-84da-40b2-b134-51844ab26006 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:11.634808 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7d621dc8-84da-40b2-b134-51844ab26006 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:11.635245 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7d621dc8-84da-40b2-b134-51844ab26006 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:11.725977 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.objects.instance [None req-7d621dc8-84da-40b2-b134-51844ab26006 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lazy-loading 'services' on Instance uuid bb0bed4d-5279-4855-a809-a182517f5a6f {{(pid=116386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 03 03:02:11.802267 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-7d621dc8-84da-40b2-b134-51844ab26006 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "DELETE /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f/os-volume_attachments/002805bd-443b-41f5-810b-3daa4c4a0d97" status: 202 len: 0 microversion: 2.1 time: 0.182335 Feb 03 03:02:11.803321 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 397/761] 10.222.0.31 () {58 vars in 1415 bytes} [Thu Feb 3 03:02:11 2022] DELETE /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f/os-volume_attachments/002805bd-443b-41f5-810b-3daa4c4a0d97 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 03 03:02:11.970957 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-d2a5e0a9-9a8a-4592-90b8-f949de25af6a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:11.971979 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-d2a5e0a9-9a8a-4592-90b8-f949de25af6a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:11.980038 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d2a5e0a9-9a8a-4592-90b8-f949de25af6a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:11.980536 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d2a5e0a9-9a8a-4592-90b8-f949de25af6a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:11.984574 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d2a5e0a9-9a8a-4592-90b8-f949de25af6a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:11.985517 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d2a5e0a9-9a8a-4592-90b8-f949de25af6a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:12.155823 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-d2a5e0a9-9a8a-4592-90b8-f949de25af6a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:12.163887 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-d2a5e0a9-9a8a-4592-90b8-f949de25af6a tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1578 microversion: 2.1 time: 0.196597 Feb 03 03:02:12.164468 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 365/762] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:11 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1578 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:12.928369 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-ec65d2a4-6709-4a3f-9a08-d99e742ef66c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:12.930179 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-ec65d2a4-6709-4a3f-9a08-d99e742ef66c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:12.936991 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ec65d2a4-6709-4a3f-9a08-d99e742ef66c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:12.937432 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ec65d2a4-6709-4a3f-9a08-d99e742ef66c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:12.938207 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ec65d2a4-6709-4a3f-9a08-d99e742ef66c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:12.938634 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ec65d2a4-6709-4a3f-9a08-d99e742ef66c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:12.967457 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-ec65d2a4-6709-4a3f-9a08-d99e742ef66c tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f/os-volume_attachments/181d6409-7281-4db6-80a2-32fd13b10686" status: 200 len: 194 microversion: 2.1 time: 0.045110 Feb 03 03:02:12.968067 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 398/763] 10.222.0.31 () {58 vars in 1412 bytes} [Thu Feb 3 03:02:12 2022] GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f/os-volume_attachments/181d6409-7281-4db6-80a2-32fd13b10686 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:02:12.978496 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-67eb26f1-32fd-4248-b99e-ce03e8af49b7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:12.979077 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-67eb26f1-32fd-4248-b99e-ce03e8af49b7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:12.985644 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-67eb26f1-32fd-4248-b99e-ce03e8af49b7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:12.986084 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-67eb26f1-32fd-4248-b99e-ce03e8af49b7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:12.986963 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-67eb26f1-32fd-4248-b99e-ce03e8af49b7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:12.987396 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-67eb26f1-32fd-4248-b99e-ce03e8af49b7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:13.078068 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.objects.instance [None req-67eb26f1-32fd-4248-b99e-ce03e8af49b7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lazy-loading 'services' on Instance uuid bb0bed4d-5279-4855-a809-a182517f5a6f {{(pid=116385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 03 03:02:13.164954 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-67eb26f1-32fd-4248-b99e-ce03e8af49b7 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "DELETE /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f/os-volume_attachments/181d6409-7281-4db6-80a2-32fd13b10686" status: 202 len: 0 microversion: 2.1 time: 0.189894 Feb 03 03:02:13.165510 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 366/764] 10.222.0.31 () {58 vars in 1415 bytes} [Thu Feb 3 03:02:12 2022] DELETE /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f/os-volume_attachments/181d6409-7281-4db6-80a2-32fd13b10686 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 03 03:02:13.181099 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-166bdb1f-df34-4578-8a34-2fdf92269905 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:13.181709 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-166bdb1f-df34-4578-8a34-2fdf92269905 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:13.195417 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-166bdb1f-df34-4578-8a34-2fdf92269905 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:13.196421 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-166bdb1f-df34-4578-8a34-2fdf92269905 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:13.207225 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-166bdb1f-df34-4578-8a34-2fdf92269905 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:13.208378 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-166bdb1f-df34-4578-8a34-2fdf92269905 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:13.370098 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-166bdb1f-df34-4578-8a34-2fdf92269905 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:13.379139 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-166bdb1f-df34-4578-8a34-2fdf92269905 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1578 microversion: 2.1 time: 0.201862 Feb 03 03:02:13.379827 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 399/765] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:13 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1578 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:14.355859 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-a4d40dce-7742-40a0-a7d8-4a8f7284f015 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:14.357030 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-a4d40dce-7742-40a0-a7d8-4a8f7284f015 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:14.363778 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a4d40dce-7742-40a0-a7d8-4a8f7284f015 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:14.364228 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a4d40dce-7742-40a0-a7d8-4a8f7284f015 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:14.365045 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a4d40dce-7742-40a0-a7d8-4a8f7284f015 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:14.365501 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a4d40dce-7742-40a0-a7d8-4a8f7284f015 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:14.396263 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-7dc4e4fc-4c43-4abc-aa21-42e7154fad5f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:14.396940 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-a4d40dce-7742-40a0-a7d8-4a8f7284f015 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044899 Feb 03 03:02:14.397036 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-7dc4e4fc-4c43-4abc-aa21-42e7154fad5f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:14.400159 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 367/766] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Feb 3 03:02:14 2022] GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 03 03:02:14.404373 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7dc4e4fc-4c43-4abc-aa21-42e7154fad5f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:14.404835 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7dc4e4fc-4c43-4abc-aa21-42e7154fad5f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:14.405655 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7dc4e4fc-4c43-4abc-aa21-42e7154fad5f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:14.406081 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7dc4e4fc-4c43-4abc-aa21-42e7154fad5f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:14.497643 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-20856f73-5105-4683-beb8-8788f5a0fef2 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:14.498650 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-20856f73-5105-4683-beb8-8788f5a0fef2 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:14.504690 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-20856f73-5105-4683-beb8-8788f5a0fef2 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:14.505163 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-20856f73-5105-4683-beb8-8788f5a0fef2 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:14.505944 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-20856f73-5105-4683-beb8-8788f5a0fef2 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:14.506373 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-20856f73-5105-4683-beb8-8788f5a0fef2 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:14.538357 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-20856f73-5105-4683-beb8-8788f5a0fef2 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044382 Feb 03 03:02:14.538916 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 368/767] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Feb 3 03:02:14 2022] GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 03 03:02:14.542354 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-7dc4e4fc-4c43-4abc-aa21-42e7154fad5f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:14.550421 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-7dc4e4fc-4c43-4abc-aa21-42e7154fad5f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1578 microversion: 2.1 time: 0.157877 Feb 03 03:02:14.551013 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 400/768] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:14 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:14.598283 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-0a267cc0-0c47-4164-9ad9-534417100f72 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:14.598719 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-0a267cc0-0c47-4164-9ad9-534417100f72 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:14.605406 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0a267cc0-0c47-4164-9ad9-534417100f72 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:14.605851 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0a267cc0-0c47-4164-9ad9-534417100f72 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:14.606727 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0a267cc0-0c47-4164-9ad9-534417100f72 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:14.607269 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-0a267cc0-0c47-4164-9ad9-534417100f72 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:14.633550 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-0a267cc0-0c47-4164-9ad9-534417100f72 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Going to try to terminate instance {{(pid=116385) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 03 03:02:14.715157 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-0a267cc0-0c47-4164-9ad9-534417100f72 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "DELETE /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f" status: 204 len: 0 microversion: 2.1 time: 0.120563 Feb 03 03:02:14.715729 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 369/769] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Feb 3 03:02:14 2022] DELETE /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 03 03:02:14.724559 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-d98c7874-fb52-4536-8ea5-f8bb3ba3558d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:14.725454 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-d98c7874-fb52-4536-8ea5-f8bb3ba3558d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:14.731560 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d98c7874-fb52-4536-8ea5-f8bb3ba3558d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:14.732019 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d98c7874-fb52-4536-8ea5-f8bb3ba3558d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:14.732809 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d98c7874-fb52-4536-8ea5-f8bb3ba3558d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:14.733413 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d98c7874-fb52-4536-8ea5-f8bb3ba3558d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:14.877977 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-d98c7874-fb52-4536-8ea5-f8bb3ba3558d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:14.886073 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-d98c7874-fb52-4536-8ea5-f8bb3ba3558d tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f" status: 200 len: 1672 microversion: 2.1 time: 0.165493 Feb 03 03:02:14.886639 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 401/770] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:14 2022] GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:15.328235 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-84c5b3e1-47f1-427c-a0cc-bd4ec81f9b75 req-e379d1f2-747b-4c16-8fa5-c91106dd7837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a23dfa-b676-4e5a-b50a-126b1edd49e5", "name": "network-vif-plugged", "status": "completed", "tag": "e9d2989c-2c82-4969-8caa-45dce6105669"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:02:15.329748 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:02:15.329748 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:02:15.336595 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-84c5b3e1-47f1-427c-a0cc-bd4ec81f9b75 req-e379d1f2-747b-4c16-8fa5-c91106dd7837 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:15.337059 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-84c5b3e1-47f1-427c-a0cc-bd4ec81f9b75 req-e379d1f2-747b-4c16-8fa5-c91106dd7837 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:15.349925 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-84c5b3e1-47f1-427c-a0cc-bd4ec81f9b75 req-e379d1f2-747b-4c16-8fa5-c91106dd7837 service nova] Creating event network-vif-plugged:e9d2989c-2c82-4969-8caa-45dce6105669 for instance 76a23dfa-b676-4e5a-b50a-126b1edd49e5 on hv-cinder-82758 Feb 03 03:02:15.358865 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-84c5b3e1-47f1-427c-a0cc-bd4ec81f9b75 req-e379d1f2-747b-4c16-8fa5-c91106dd7837 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090358 Feb 03 03:02:15.359822 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 370/771] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:02:15.567324 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-f871f7ff-bb6f-4dec-b949-fba3f4a850ad tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:15.567933 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-f871f7ff-bb6f-4dec-b949-fba3f4a850ad tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:15.574614 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f871f7ff-bb6f-4dec-b949-fba3f4a850ad tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:15.575081 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f871f7ff-bb6f-4dec-b949-fba3f4a850ad tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:15.575862 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f871f7ff-bb6f-4dec-b949-fba3f4a850ad tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:15.576508 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f871f7ff-bb6f-4dec-b949-fba3f4a850ad tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:15.765045 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-f871f7ff-bb6f-4dec-b949-fba3f4a850ad tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:15.773033 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-f871f7ff-bb6f-4dec-b949-fba3f4a850ad tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1578 microversion: 2.1 time: 0.209414 Feb 03 03:02:15.773573 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 402/772] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:15 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1578 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:15.907933 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-2fd9eeb3-e8e1-42b6-8d80-1d71092ac580 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:15.908627 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-2fd9eeb3-e8e1-42b6-8d80-1d71092ac580 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:15.915508 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2fd9eeb3-e8e1-42b6-8d80-1d71092ac580 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:15.915979 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2fd9eeb3-e8e1-42b6-8d80-1d71092ac580 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:15.916750 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2fd9eeb3-e8e1-42b6-8d80-1d71092ac580 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:15.917206 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2fd9eeb3-e8e1-42b6-8d80-1d71092ac580 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:16.053549 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-2fd9eeb3-e8e1-42b6-8d80-1d71092ac580 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:16.061135 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-2fd9eeb3-e8e1-42b6-8d80-1d71092ac580 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f" status: 200 len: 1672 microversion: 2.1 time: 0.159581 Feb 03 03:02:16.061750 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 371/773] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:15 2022] GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:16.790279 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-8b8a5f41-5669-4db4-bac5-872452d4ce94 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:16.790892 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-8b8a5f41-5669-4db4-bac5-872452d4ce94 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:16.798379 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8b8a5f41-5669-4db4-bac5-872452d4ce94 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:16.798817 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8b8a5f41-5669-4db4-bac5-872452d4ce94 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:16.799590 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8b8a5f41-5669-4db4-bac5-872452d4ce94 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:16.800018 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8b8a5f41-5669-4db4-bac5-872452d4ce94 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:16.942220 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-8b8a5f41-5669-4db4-bac5-872452d4ce94 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:16.950100 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-8b8a5f41-5669-4db4-bac5-872452d4ce94 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1578 microversion: 2.1 time: 0.163502 Feb 03 03:02:16.950667 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 403/774] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:16 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:17.078616 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-ccacb795-aae1-482d-9612-c9b4222fef6e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:17.079895 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-ccacb795-aae1-482d-9612-c9b4222fef6e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:17.088039 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ccacb795-aae1-482d-9612-c9b4222fef6e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:17.088502 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ccacb795-aae1-482d-9612-c9b4222fef6e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:17.089341 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ccacb795-aae1-482d-9612-c9b4222fef6e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:17.089775 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ccacb795-aae1-482d-9612-c9b4222fef6e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:17.298427 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-ccacb795-aae1-482d-9612-c9b4222fef6e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:17.308224 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-ccacb795-aae1-482d-9612-c9b4222fef6e tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f" status: 200 len: 1672 microversion: 2.1 time: 0.233590 Feb 03 03:02:17.309043 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 372/775] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:17 2022] GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f => generated 1672 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:17.966629 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-e5ae3a7d-425e-49b2-ba3d-a3368fb79f98 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:17.967235 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-e5ae3a7d-425e-49b2-ba3d-a3368fb79f98 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:17.974424 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e5ae3a7d-425e-49b2-ba3d-a3368fb79f98 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:17.974886 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e5ae3a7d-425e-49b2-ba3d-a3368fb79f98 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:17.975797 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e5ae3a7d-425e-49b2-ba3d-a3368fb79f98 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:17.976279 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e5ae3a7d-425e-49b2-ba3d-a3368fb79f98 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:18.232539 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-e5ae3a7d-425e-49b2-ba3d-a3368fb79f98 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:18.240037 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-e5ae3a7d-425e-49b2-ba3d-a3368fb79f98 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1565 microversion: 2.1 time: 0.277201 Feb 03 03:02:18.240613 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 404/776] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:17 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1565 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:18.325571 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-efa4ff74-bbff-4df1-a811-1b4613c07ce9 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:18.326180 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-efa4ff74-bbff-4df1-a811-1b4613c07ce9 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:18.335917 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-efa4ff74-bbff-4df1-a811-1b4613c07ce9 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:18.336503 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-efa4ff74-bbff-4df1-a811-1b4613c07ce9 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:18.338217 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-efa4ff74-bbff-4df1-a811-1b4613c07ce9 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:18.338908 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-efa4ff74-bbff-4df1-a811-1b4613c07ce9 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:18.360346 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-6620203c-a23b-418e-8e91-940a9045d6b3 req-cea050d0-c423-498f-9d79-e0f5e40a2ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb0bed4d-5279-4855-a809-a182517f5a6f", "name": "network-vif-deleted", "tag": "d06bb55a-14cb-478e-8943-fb3e7c453450"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:02:18.362416 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:02:18.362416 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 03:02:18.373579 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-6620203c-a23b-418e-8e91-940a9045d6b3 req-cea050d0-c423-498f-9d79-e0f5e40a2ac6 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:18.374018 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-6620203c-a23b-418e-8e91-940a9045d6b3 req-cea050d0-c423-498f-9d79-e0f5e40a2ac6 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:18.399595 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-6620203c-a23b-418e-8e91-940a9045d6b3 req-cea050d0-c423-498f-9d79-e0f5e40a2ac6 service nova] Creating event network-vif-deleted:d06bb55a-14cb-478e-8943-fb3e7c453450 for instance bb0bed4d-5279-4855-a809-a182517f5a6f on hv-cinder-82758 Feb 03 03:02:18.410843 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-6620203c-a23b-418e-8e91-940a9045d6b3 req-cea050d0-c423-498f-9d79-e0f5e40a2ac6 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052232 Feb 03 03:02:18.412125 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 405/777] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 03 03:02:18.453553 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-efa4ff74-bbff-4df1-a811-1b4613c07ce9 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '076a8d1b26864240a8007d2ac7080e0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c189a73642b4f5ba787addbc275d4c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:18.465453 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-efa4ff74-bbff-4df1-a811-1b4613c07ce9 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f" status: 200 len: 1605 microversion: 2.1 time: 0.143415 Feb 03 03:02:18.466111 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 373/778] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:18 2022] GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f => generated 1605 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:19.486389 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-ab8ab704-996d-49e1-9bff-beca7ec8d968 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:19.487122 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-ab8ab704-996d-49e1-9bff-beca7ec8d968 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:19.494315 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ab8ab704-996d-49e1-9bff-beca7ec8d968 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:19.494764 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ab8ab704-996d-49e1-9bff-beca7ec8d968 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:19.495553 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ab8ab704-996d-49e1-9bff-beca7ec8d968 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:19.496045 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ab8ab704-996d-49e1-9bff-beca7ec8d968 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:19.510332 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.wsgi [None req-ab8ab704-996d-49e1-9bff-beca7ec8d968 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] HTTP exception thrown: Instance bb0bed4d-5279-4855-a809-a182517f5a6f could not be found. Feb 03 03:02:19.510934 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-ab8ab704-996d-49e1-9bff-beca7ec8d968 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Returning 404 to user: Instance bb0bed4d-5279-4855-a809-a182517f5a6f could not be found. {{(pid=116386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 03:02:19.511772 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-ab8ab704-996d-49e1-9bff-beca7ec8d968 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f" status: 404 len: 111 microversion: 2.1 time: 0.032609 Feb 03 03:02:19.512353 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 406/779] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:19 2022] GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 03:02:19.521882 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-026e860c-a838-4590-8afb-718c29d3dfd0 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '.version_select at 0x7ff99d114f70>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:19.541834 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-026e860c-a838-4590-8afb-718c29d3dfd0 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-552541862" status: 202 len: 0 microversion: 2.1 time: 0.023491 Feb 03 03:02:19.542323 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 374/780] 10.222.0.31 () {58 vars in 1217 bytes} [Thu Feb 3 03:02:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-552541862 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 03 03:02:22.434252 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-57026a21-7ee7-4ba5-97c6-0a5674683962 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:22.434738 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-57026a21-7ee7-4ba5-97c6-0a5674683962 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:22.441416 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-57026a21-7ee7-4ba5-97c6-0a5674683962 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:22.441853 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-57026a21-7ee7-4ba5-97c6-0a5674683962 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:22.442626 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-57026a21-7ee7-4ba5-97c6-0a5674683962 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:22.443054 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-57026a21-7ee7-4ba5-97c6-0a5674683962 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:22.456479 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.wsgi [None req-57026a21-7ee7-4ba5-97c6-0a5674683962 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] HTTP exception thrown: Instance bb0bed4d-5279-4855-a809-a182517f5a6f could not be found. Feb 03 03:02:22.457089 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-57026a21-7ee7-4ba5-97c6-0a5674683962 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Returning 404 to user: Instance bb0bed4d-5279-4855-a809-a182517f5a6f could not be found. {{(pid=116386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 03:02:22.457879 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-57026a21-7ee7-4ba5-97c6-0a5674683962 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "DELETE /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f" status: 404 len: 111 microversion: 2.1 time: 0.027322 Feb 03 03:02:22.458380 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 407/781] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Feb 3 03:02:22 2022] DELETE /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 03:02:22.466848 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-1576cb13-fdc4-467b-be2f-2a7e7708e8e8 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:22.467458 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-1576cb13-fdc4-467b-be2f-2a7e7708e8e8 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: bb0bed4d-5279-4855-a809-a182517f5a6f] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:22.475178 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1576cb13-fdc4-467b-be2f-2a7e7708e8e8 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:22.475625 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1576cb13-fdc4-467b-be2f-2a7e7708e8e8 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:22.476408 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1576cb13-fdc4-467b-be2f-2a7e7708e8e8 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:22.476874 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-1576cb13-fdc4-467b-be2f-2a7e7708e8e8 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:22.489792 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.wsgi [None req-1576cb13-fdc4-467b-be2f-2a7e7708e8e8 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] HTTP exception thrown: Instance bb0bed4d-5279-4855-a809-a182517f5a6f could not be found. Feb 03 03:02:22.490362 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-1576cb13-fdc4-467b-be2f-2a7e7708e8e8 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Returning 404 to user: Instance bb0bed4d-5279-4855-a809-a182517f5a6f could not be found. {{(pid=116385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 03:02:22.491172 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-1576cb13-fdc4-467b-be2f-2a7e7708e8e8 tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f" status: 404 len: 111 microversion: 2.1 time: 0.028551 Feb 03 03:02:22.491664 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 375/782] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:22 2022] GET /compute/v2.1/servers/bb0bed4d-5279-4855-a809-a182517f5a6f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 03:02:23.627166 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-b2c6ccb7-566e-4267-9042-5c5d46232e5f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:23.627737 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-b2c6ccb7-566e-4267-9042-5c5d46232e5f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:23.635161 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b2c6ccb7-566e-4267-9042-5c5d46232e5f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:23.635602 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b2c6ccb7-566e-4267-9042-5c5d46232e5f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:23.636380 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b2c6ccb7-566e-4267-9042-5c5d46232e5f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:23.636821 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b2c6ccb7-566e-4267-9042-5c5d46232e5f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:23.650304 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.wsgi [None req-b2c6ccb7-566e-4267-9042-5c5d46232e5f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] HTTP exception thrown: Instance 9a00957e-c905-4466-8a03-befe71ab1e1c could not be found. Feb 03 03:02:23.650902 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-b2c6ccb7-566e-4267-9042-5c5d46232e5f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Returning 404 to user: Instance 9a00957e-c905-4466-8a03-befe71ab1e1c could not be found. {{(pid=116386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 03:02:23.651684 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-b2c6ccb7-566e-4267-9042-5c5d46232e5f tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "DELETE /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 404 len: 111 microversion: 2.1 time: 0.029510 Feb 03 03:02:23.652240 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 408/783] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Feb 3 03:02:23 2022] DELETE /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 03:02:23.660143 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-082938a0-e160-4abb-a8fa-49612523b0ba tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:23.660748 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-082938a0-e160-4abb-a8fa-49612523b0ba tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] [instance: 9a00957e-c905-4466-8a03-befe71ab1e1c] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:23.667153 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-082938a0-e160-4abb-a8fa-49612523b0ba tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:23.667609 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-082938a0-e160-4abb-a8fa-49612523b0ba tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:23.668331 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-082938a0-e160-4abb-a8fa-49612523b0ba tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:23.668818 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-082938a0-e160-4abb-a8fa-49612523b0ba tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:23.683148 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.wsgi [None req-082938a0-e160-4abb-a8fa-49612523b0ba tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] HTTP exception thrown: Instance 9a00957e-c905-4466-8a03-befe71ab1e1c could not be found. Feb 03 03:02:23.683759 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-082938a0-e160-4abb-a8fa-49612523b0ba tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] Returning 404 to user: Instance 9a00957e-c905-4466-8a03-befe71ab1e1c could not be found. {{(pid=116385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 03:02:23.684579 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-082938a0-e160-4abb-a8fa-49612523b0ba tempest-AttachVolumeTestJSON-1770210495 tempest-AttachVolumeTestJSON-1770210495-project] 10.222.0.31 "GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c" status: 404 len: 111 microversion: 2.1 time: 0.028168 Feb 03 03:02:23.685151 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 376/784] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:23 2022] GET /compute/v2.1/servers/9a00957e-c905-4466-8a03-befe71ab1e1c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 03:02:24.802686 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-9ffb6d58-8d2d-4bf3-b36b-69ca289e304a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1115647032", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1043137288", "security_groups": [{"name": "tempest-secgroup-smoke-1844821108"}], "block_device_mapping_v2": [{"uuid": "b56852c4-375d-43cc-8648-6dd0f5f649b2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1f509aa5-ebd0-421b-bf85-c9ee605b4c0c"}]}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:02:24.964473 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.network.neutron [None req-9ffb6d58-8d2d-4bf3-b36b-69ca289e304a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] validate_networks() for [('1f509aa5-ebd0-421b-bf85-c9ee605b4c0c', None, None, None, None, None)] {{(pid=116386) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 03 03:02:25.853274 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-9ffb6d58-8d2d-4bf3-b36b-69ca289e304a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Flavor limits 0:0:0 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 03 03:02:25.853851 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-9ffb6d58-8d2d-4bf3-b36b-69ca289e304a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Image limits 0:0:0 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 03 03:02:25.854235 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-9ffb6d58-8d2d-4bf3-b36b-69ca289e304a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Flavor pref 0:0:0 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 03 03:02:25.854567 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-9ffb6d58-8d2d-4bf3-b36b-69ca289e304a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Image pref 0:0:0 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 03 03:02:25.854967 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-9ffb6d58-8d2d-4bf3-b36b-69ca289e304a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 03 03:02:25.863944 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-9ffb6d58-8d2d-4bf3-b36b-69ca289e304a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:25.864388 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-9ffb6d58-8d2d-4bf3-b36b-69ca289e304a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:25.865431 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-9ffb6d58-8d2d-4bf3-b36b-69ca289e304a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:25.865868 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-9ffb6d58-8d2d-4bf3-b36b-69ca289e304a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:25.884501 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.quota [None req-9ffb6d58-8d2d-4bf3-b36b-69ca289e304a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Getting quotas for project 264ee2f5b580483c85a302041b05c23f. Resources: {'cores', 'ram', 'instances'} {{(pid=116386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 03:02:25.888809 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.quota [None req-9ffb6d58-8d2d-4bf3-b36b-69ca289e304a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Getting quotas for user 6a97115409ba4be989f9071c61df79a5 and project 264ee2f5b580483c85a302041b05c23f. Resources: {'cores', 'ram', 'instances'} {{(pid=116386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 03:02:25.946193 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-9ffb6d58-8d2d-4bf3-b36b-69ca289e304a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Going to run 1 instances... {{(pid=116386) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 03 03:02:25.948443 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-9ffb6d58-8d2d-4bf3-b36b-69ca289e304a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 4cbae628-c830-4c00-9f73-83e7b4902acd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b56852c4-375d-43cc-8648-6dd0f5f649b2',volume_size=None,volume_type=None)] {{(pid=116386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 03 03:02:26.074671 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-9ffb6d58-8d2d-4bf3-b36b-69ca289e304a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.275743 Feb 03 03:02:26.075467 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 409/785] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Feb 3 03:02:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1277 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 03 03:02:26.089802 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-50d20735-7fc0-4fcb-a8ed-d063ab0e7db3 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:26.090401 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-50d20735-7fc0-4fcb-a8ed-d063ab0e7db3 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 4cbae628-c830-4c00-9f73-83e7b4902acd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:26.168952 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-50d20735-7fc0-4fcb-a8ed-d063ab0e7db3 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:26.176979 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-50d20735-7fc0-4fcb-a8ed-d063ab0e7db3 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd" status: 200 len: 1095 microversion: 2.1 time: 0.090811 Feb 03 03:02:26.179678 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 377/786] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:26 2022] GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd => generated 1095 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:27.194967 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-19e9af0b-5cf9-415c-9e83-2d656d51503b tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:27.196283 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-19e9af0b-5cf9-415c-9e83-2d656d51503b tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 4cbae628-c830-4c00-9f73-83e7b4902acd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:27.203903 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-19e9af0b-5cf9-415c-9e83-2d656d51503b tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:27.204691 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-19e9af0b-5cf9-415c-9e83-2d656d51503b tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:27.205827 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-19e9af0b-5cf9-415c-9e83-2d656d51503b tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:27.206606 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-19e9af0b-5cf9-415c-9e83-2d656d51503b tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:27.355340 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-19e9af0b-5cf9-415c-9e83-2d656d51503b tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:27.367342 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-19e9af0b-5cf9-415c-9e83-2d656d51503b tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd" status: 200 len: 1211 microversion: 2.1 time: 0.176958 Feb 03 03:02:27.367938 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 410/787] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:27 2022] GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd => generated 1211 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:28.385061 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-9f387abd-8ccd-48d3-8386-4fd48f4c5032 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:28.385775 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-9f387abd-8ccd-48d3-8386-4fd48f4c5032 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 4cbae628-c830-4c00-9f73-83e7b4902acd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:28.392841 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9f387abd-8ccd-48d3-8386-4fd48f4c5032 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:28.393282 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9f387abd-8ccd-48d3-8386-4fd48f4c5032 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:28.394059 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9f387abd-8ccd-48d3-8386-4fd48f4c5032 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:28.394486 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9f387abd-8ccd-48d3-8386-4fd48f4c5032 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:28.653996 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-9f387abd-8ccd-48d3-8386-4fd48f4c5032 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:28.665306 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-9f387abd-8ccd-48d3-8386-4fd48f4c5032 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd" status: 200 len: 1267 microversion: 2.1 time: 0.283880 Feb 03 03:02:28.678528 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 378/788] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:28 2022] GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd => generated 1267 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:28.789129 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-03d197f7-1faf-42fb-bcba-694c4ab942dc req-876306dc-20dd-4edb-8bce-83d1a4b09860 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cbae628-c830-4c00-9f73-83e7b4902acd", "tag": "5c0fa8f4-c18a-48b0-aa0e-25cfceb29350"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:02:28.790747 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:02:28.790747 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 03:02:28.797963 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-03d197f7-1faf-42fb-bcba-694c4ab942dc req-876306dc-20dd-4edb-8bce-83d1a4b09860 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:28.798440 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-03d197f7-1faf-42fb-bcba-694c4ab942dc req-876306dc-20dd-4edb-8bce-83d1a4b09860 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:28.815152 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-03d197f7-1faf-42fb-bcba-694c4ab942dc req-876306dc-20dd-4edb-8bce-83d1a4b09860 service nova] Creating event network-changed:5c0fa8f4-c18a-48b0-aa0e-25cfceb29350 for instance 4cbae628-c830-4c00-9f73-83e7b4902acd on hv-cinder-82758 Feb 03 03:02:28.821044 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-03d197f7-1faf-42fb-bcba-694c4ab942dc req-876306dc-20dd-4edb-8bce-83d1a4b09860 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035092 Feb 03 03:02:28.825019 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 411/789] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:02:29.126783 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-6d32b012-267d-406d-8123-b4adeb7b9aba tempest-VolumesNegativeTest-810352707 tempest-VolumesNegativeTest-810352707-project] Action: 'create', calling method: .version_select at 0x7ff99cfbf160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-139891747", "metadata": {"Type": "work"}}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:02:29.128213 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-6d32b012-267d-406d-8123-b4adeb7b9aba tempest-VolumesNegativeTest-810352707 tempest-VolumesNegativeTest-810352707-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 03:02:29.129029 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-6d32b012-267d-406d-8123-b4adeb7b9aba tempest-VolumesNegativeTest-810352707 tempest-VolumesNegativeTest-810352707-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.116649 Feb 03 03:02:29.129556 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 379/790] 10.222.0.31 () {60 vars in 1155 bytes} [Thu Feb 3 03:02:29 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 03 03:02:29.139111 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-c856cad3-8984-4057-9924-cfe5553eedcd tempest-VolumesNegativeTest-810352707 tempest-VolumesNegativeTest-810352707-project] Action: 'create', calling method: .version_select at 0x7ff99cee2550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-522569615", "metadata": {"Type": "work"}}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:02:29.140566 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-c856cad3-8984-4057-9924-cfe5553eedcd tempest-VolumesNegativeTest-810352707 tempest-VolumesNegativeTest-810352707-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 03:02:29.141602 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-c856cad3-8984-4057-9924-cfe5553eedcd tempest-VolumesNegativeTest-810352707 tempest-VolumesNegativeTest-810352707-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006555 Feb 03 03:02:29.142156 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 412/791] 10.222.0.31 () {60 vars in 1155 bytes} [Thu Feb 3 03:02:29 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 03 03:02:29.150506 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-9a34fa11-c06a-43e9-bebb-d7f722a81ab4 tempest-VolumesNegativeTest-810352707 tempest-VolumesNegativeTest-810352707-project] Action: 'create', calling method: .version_select at 0x7ff99cf3d160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1080253666", "metadata": {"Type": "work"}}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:02:29.151685 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-9a34fa11-c06a-43e9-bebb-d7f722a81ab4 tempest-VolumesNegativeTest-810352707 tempest-VolumesNegativeTest-810352707-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 03:02:29.152460 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-9a34fa11-c06a-43e9-bebb-d7f722a81ab4 tempest-VolumesNegativeTest-810352707 tempest-VolumesNegativeTest-810352707-project] 10.222.0.31 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005555 Feb 03 03:02:29.152953 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 380/792] 10.222.0.31 () {60 vars in 1155 bytes} [Thu Feb 3 03:02:29 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 03 03:02:29.161246 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-05725b0a-39d3-406a-b34e-69bfa8d362a1 tempest-VolumesNegativeTest-810352707 tempest-VolumesNegativeTest-810352707-project] Calling method '.version_select at 0x7ff99cee21f0>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:29.188446 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.wsgi [None req-05725b0a-39d3-406a-b34e-69bfa8d362a1 tempest-VolumesNegativeTest-810352707 tempest-VolumesNegativeTest-810352707-project] HTTP exception thrown: Volume tempest-invalid-362926985 could not be found. Feb 03 03:02:29.189652 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-05725b0a-39d3-406a-b34e-69bfa8d362a1 tempest-VolumesNegativeTest-810352707 tempest-VolumesNegativeTest-810352707-project] Returning 404 to user: Volume tempest-invalid-362926985 could not be found. {{(pid=116386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 03:02:29.190478 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-05725b0a-39d3-406a-b34e-69bfa8d362a1 tempest-VolumesNegativeTest-810352707 tempest-VolumesNegativeTest-810352707-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/tempest-invalid-362926985" status: 404 len: 98 microversion: 2.1 time: 0.032807 Feb 03 03:02:29.191147 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 413/793] 10.222.0.31 () {58 vars in 1214 bytes} [Thu Feb 3 03:02:29 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-362926985 => generated 98 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Feb 03 03:02:29.200754 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-9ef8a9af-0ddb-43bb-a752-a70319ec7a61 tempest-VolumesNegativeTest-810352707 tempest-VolumesNegativeTest-810352707-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004490 Feb 03 03:02:29.201267 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 381/794] 10.222.0.31 () {58 vars in 1139 bytes} [Thu Feb 3 03:02:29 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 03 03:02:29.210021 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-56ba78b7-94c6-48f5-85cd-286d89e4dc85 tempest-VolumesNegativeTest-810352707 tempest-VolumesNegativeTest-810352707-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003554 Feb 03 03:02:29.210660 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 414/795] 10.222.0.31 () {58 vars in 1136 bytes} [Thu Feb 3 03:02:29 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 03 03:02:29.219228 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-0c851b01-2224-45ba-a529-42c18c223f0b tempest-VolumesNegativeTest-810352707 tempest-VolumesNegativeTest-810352707-project] Calling method '.version_select at 0x7ff99cf410d0>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:29.248147 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.wsgi [None req-0c851b01-2224-45ba-a529-42c18c223f0b tempest-VolumesNegativeTest-810352707 tempest-VolumesNegativeTest-810352707-project] HTTP exception thrown: Volume d49c1e1d-16f3-4eee-8e06-54c93dbae19f could not be found. Feb 03 03:02:29.248787 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-0c851b01-2224-45ba-a529-42c18c223f0b tempest-VolumesNegativeTest-810352707 tempest-VolumesNegativeTest-810352707-project] Returning 404 to user: Volume d49c1e1d-16f3-4eee-8e06-54c93dbae19f could not be found. {{(pid=116385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 03:02:29.249633 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-0c851b01-2224-45ba-a529-42c18c223f0b tempest-VolumesNegativeTest-810352707 tempest-VolumesNegativeTest-810352707-project] 10.222.0.31 "DELETE /compute/v2.1/os-volumes/d49c1e1d-16f3-4eee-8e06-54c93dbae19f" status: 404 len: 109 microversion: 2.1 time: 0.033987 Feb 03 03:02:29.250176 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 382/796] 10.222.0.31 () {58 vars in 1247 bytes} [Thu Feb 3 03:02:29 2022] DELETE /compute/v2.1/os-volumes/d49c1e1d-16f3-4eee-8e06-54c93dbae19f => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 03:02:29.259195 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-8a3a645c-bd10-49ef-96a4-1ff9eee43300 tempest-VolumesNegativeTest-810352707 tempest-VolumesNegativeTest-810352707-project] Calling method '.version_select at 0x7ff99dba3280>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:29.287676 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.wsgi [None req-8a3a645c-bd10-49ef-96a4-1ff9eee43300 tempest-VolumesNegativeTest-810352707 tempest-VolumesNegativeTest-810352707-project] HTTP exception thrown: Volume 2f26a09a-5007-498a-beca-97230fc6a7c2 could not be found. Feb 03 03:02:29.287676 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-8a3a645c-bd10-49ef-96a4-1ff9eee43300 tempest-VolumesNegativeTest-810352707 tempest-VolumesNegativeTest-810352707-project] Returning 404 to user: Volume 2f26a09a-5007-498a-beca-97230fc6a7c2 could not be found. {{(pid=116386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 03:02:29.287676 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-8a3a645c-bd10-49ef-96a4-1ff9eee43300 tempest-VolumesNegativeTest-810352707 tempest-VolumesNegativeTest-810352707-project] 10.222.0.31 "GET /compute/v2.1/os-volumes/2f26a09a-5007-498a-beca-97230fc6a7c2" status: 404 len: 109 microversion: 2.1 time: 0.032141 Feb 03 03:02:29.288205 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 415/797] 10.222.0.31 () {58 vars in 1244 bytes} [Thu Feb 3 03:02:29 2022] GET /compute/v2.1/os-volumes/2f26a09a-5007-498a-beca-97230fc6a7c2 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 03:02:29.686178 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-bb7b997c-f0ae-4730-8d78-bf55caeaa090 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:29.686777 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-bb7b997c-f0ae-4730-8d78-bf55caeaa090 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 4cbae628-c830-4c00-9f73-83e7b4902acd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:29.694043 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bb7b997c-f0ae-4730-8d78-bf55caeaa090 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:29.694474 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bb7b997c-f0ae-4730-8d78-bf55caeaa090 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:29.695281 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bb7b997c-f0ae-4730-8d78-bf55caeaa090 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:29.695896 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bb7b997c-f0ae-4730-8d78-bf55caeaa090 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:29.853261 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-bb7b997c-f0ae-4730-8d78-bf55caeaa090 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:29.860733 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-bb7b997c-f0ae-4730-8d78-bf55caeaa090 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd" status: 200 len: 1267 microversion: 2.1 time: 0.178664 Feb 03 03:02:29.861373 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 383/798] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:29 2022] GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:30.878343 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-d5fd3a82-735f-4f4e-baed-fc2bb2b6716f tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:30.879783 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-d5fd3a82-735f-4f4e-baed-fc2bb2b6716f tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 4cbae628-c830-4c00-9f73-83e7b4902acd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:30.886247 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d5fd3a82-735f-4f4e-baed-fc2bb2b6716f tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:30.886697 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d5fd3a82-735f-4f4e-baed-fc2bb2b6716f tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:30.887481 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d5fd3a82-735f-4f4e-baed-fc2bb2b6716f tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:30.887914 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d5fd3a82-735f-4f4e-baed-fc2bb2b6716f tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:31.026985 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-d5fd3a82-735f-4f4e-baed-fc2bb2b6716f tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:31.034808 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-d5fd3a82-735f-4f4e-baed-fc2bb2b6716f tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd" status: 200 len: 1267 microversion: 2.1 time: 0.161261 Feb 03 03:02:31.035354 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 416/799] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:30 2022] GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:32.054755 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-8bec5e08-336b-4395-a59f-db51f46e4ef0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:32.055731 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-8bec5e08-336b-4395-a59f-db51f46e4ef0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 4cbae628-c830-4c00-9f73-83e7b4902acd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:32.066070 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8bec5e08-336b-4395-a59f-db51f46e4ef0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:32.066792 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8bec5e08-336b-4395-a59f-db51f46e4ef0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:32.068055 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8bec5e08-336b-4395-a59f-db51f46e4ef0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:32.069216 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8bec5e08-336b-4395-a59f-db51f46e4ef0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:32.208553 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-8bec5e08-336b-4395-a59f-db51f46e4ef0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:32.219742 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-8bec5e08-336b-4395-a59f-db51f46e4ef0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd" status: 200 len: 1267 microversion: 2.1 time: 0.171170 Feb 03 03:02:32.220492 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 384/800] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:32 2022] GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:33.239340 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-43e498d1-83ef-482b-aa39-52410348f783 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:33.240112 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-43e498d1-83ef-482b-aa39-52410348f783 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 4cbae628-c830-4c00-9f73-83e7b4902acd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:33.249584 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-43e498d1-83ef-482b-aa39-52410348f783 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:33.250190 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-43e498d1-83ef-482b-aa39-52410348f783 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:33.251298 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-43e498d1-83ef-482b-aa39-52410348f783 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:33.251920 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-43e498d1-83ef-482b-aa39-52410348f783 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:33.388142 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-43e498d1-83ef-482b-aa39-52410348f783 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:33.399202 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-43e498d1-83ef-482b-aa39-52410348f783 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd" status: 200 len: 1267 microversion: 2.1 time: 0.164981 Feb 03 03:02:33.399895 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 417/801] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:33 2022] GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:34.415719 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-9b9475b8-224f-4368-8c7b-eebe24bf99b2 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:34.416338 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-9b9475b8-224f-4368-8c7b-eebe24bf99b2 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 4cbae628-c830-4c00-9f73-83e7b4902acd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:34.423019 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9b9475b8-224f-4368-8c7b-eebe24bf99b2 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:34.423439 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9b9475b8-224f-4368-8c7b-eebe24bf99b2 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:34.424227 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9b9475b8-224f-4368-8c7b-eebe24bf99b2 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:34.424653 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9b9475b8-224f-4368-8c7b-eebe24bf99b2 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:34.562089 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-9b9475b8-224f-4368-8c7b-eebe24bf99b2 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:34.570214 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-9b9475b8-224f-4368-8c7b-eebe24bf99b2 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd" status: 200 len: 1267 microversion: 2.1 time: 0.158516 Feb 03 03:02:34.570780 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 385/802] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:34 2022] GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:35.586120 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-805a9779-c5ae-4f2e-9f37-ebf2299108bc tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:35.586723 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-805a9779-c5ae-4f2e-9f37-ebf2299108bc tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 4cbae628-c830-4c00-9f73-83e7b4902acd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:35.595768 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-805a9779-c5ae-4f2e-9f37-ebf2299108bc tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:35.596399 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-805a9779-c5ae-4f2e-9f37-ebf2299108bc tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:35.597920 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-805a9779-c5ae-4f2e-9f37-ebf2299108bc tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:35.598492 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-805a9779-c5ae-4f2e-9f37-ebf2299108bc tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:35.740374 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-805a9779-c5ae-4f2e-9f37-ebf2299108bc tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:35.751836 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-805a9779-c5ae-4f2e-9f37-ebf2299108bc tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd" status: 200 len: 1267 microversion: 2.1 time: 0.169261 Feb 03 03:02:35.752607 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 418/803] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:35 2022] GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:36.776188 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-2b0dcd83-1646-4a77-ab57-9d8b949ce645 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:36.777278 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-2b0dcd83-1646-4a77-ab57-9d8b949ce645 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 4cbae628-c830-4c00-9f73-83e7b4902acd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:36.787063 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2b0dcd83-1646-4a77-ab57-9d8b949ce645 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:36.787503 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2b0dcd83-1646-4a77-ab57-9d8b949ce645 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:36.788279 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2b0dcd83-1646-4a77-ab57-9d8b949ce645 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:36.788740 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2b0dcd83-1646-4a77-ab57-9d8b949ce645 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:36.927176 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-2b0dcd83-1646-4a77-ab57-9d8b949ce645 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:36.935174 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-2b0dcd83-1646-4a77-ab57-9d8b949ce645 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd" status: 200 len: 1267 microversion: 2.1 time: 0.164562 Feb 03 03:02:36.935768 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 386/804] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:36 2022] GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:37.952197 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-cb951a17-81c2-43e4-9240-918778a7391b tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:37.952837 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-cb951a17-81c2-43e4-9240-918778a7391b tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 4cbae628-c830-4c00-9f73-83e7b4902acd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:37.959663 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cb951a17-81c2-43e4-9240-918778a7391b tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:37.960103 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cb951a17-81c2-43e4-9240-918778a7391b tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:37.960924 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cb951a17-81c2-43e4-9240-918778a7391b tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:37.961350 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cb951a17-81c2-43e4-9240-918778a7391b tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:38.110981 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-cb951a17-81c2-43e4-9240-918778a7391b tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:38.120302 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-cb951a17-81c2-43e4-9240-918778a7391b tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd" status: 200 len: 1267 microversion: 2.1 time: 0.171862 Feb 03 03:02:38.120872 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 419/805] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:37 2022] GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:39.136681 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-936ff75f-d3bb-4875-bcbe-78bd9459faec tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:39.137317 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-936ff75f-d3bb-4875-bcbe-78bd9459faec tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 4cbae628-c830-4c00-9f73-83e7b4902acd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:39.144517 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-936ff75f-d3bb-4875-bcbe-78bd9459faec tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:39.145001 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-936ff75f-d3bb-4875-bcbe-78bd9459faec tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:39.145773 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-936ff75f-d3bb-4875-bcbe-78bd9459faec tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:39.146204 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-936ff75f-d3bb-4875-bcbe-78bd9459faec tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:39.286488 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-936ff75f-d3bb-4875-bcbe-78bd9459faec tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:39.294205 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-936ff75f-d3bb-4875-bcbe-78bd9459faec tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd" status: 200 len: 1267 microversion: 2.1 time: 0.161099 Feb 03 03:02:39.294826 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 387/806] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:39 2022] GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:40.310780 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-5030c73d-a750-45d8-a38d-dabe7c63389a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:40.311392 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-5030c73d-a750-45d8-a38d-dabe7c63389a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 4cbae628-c830-4c00-9f73-83e7b4902acd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:40.318277 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5030c73d-a750-45d8-a38d-dabe7c63389a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:40.318762 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5030c73d-a750-45d8-a38d-dabe7c63389a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:40.319583 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5030c73d-a750-45d8-a38d-dabe7c63389a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:40.320037 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5030c73d-a750-45d8-a38d-dabe7c63389a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:40.454224 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-5030c73d-a750-45d8-a38d-dabe7c63389a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:40.462351 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-5030c73d-a750-45d8-a38d-dabe7c63389a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd" status: 200 len: 1267 microversion: 2.1 time: 0.155198 Feb 03 03:02:40.462922 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 420/807] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:40 2022] GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:41.390634 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-33004134-bfbb-43e6-990b-458b20086476 req-69b1eba9-91ac-4957-97cc-cc9957479499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cbae628-c830-4c00-9f73-83e7b4902acd", "name": "network-vif-plugged", "status": "completed", "tag": "5c0fa8f4-c18a-48b0-aa0e-25cfceb29350"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:02:41.392210 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:02:41.392210 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:02:41.399827 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-33004134-bfbb-43e6-990b-458b20086476 req-69b1eba9-91ac-4957-97cc-cc9957479499 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:41.400264 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-33004134-bfbb-43e6-990b-458b20086476 req-69b1eba9-91ac-4957-97cc-cc9957479499 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:41.412178 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-33004134-bfbb-43e6-990b-458b20086476 req-69b1eba9-91ac-4957-97cc-cc9957479499 service nova] Creating event network-vif-plugged:5c0fa8f4-c18a-48b0-aa0e-25cfceb29350 for instance 4cbae628-c830-4c00-9f73-83e7b4902acd on hv-cinder-82758 Feb 03 03:02:41.417592 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-33004134-bfbb-43e6-990b-458b20086476 req-69b1eba9-91ac-4957-97cc-cc9957479499 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030539 Feb 03 03:02:41.418404 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 388/808] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:02:41.482119 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-33169e63-d5a4-4203-a063-ff48117e360c tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:41.482840 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-33169e63-d5a4-4203-a063-ff48117e360c tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 4cbae628-c830-4c00-9f73-83e7b4902acd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:41.489352 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-33169e63-d5a4-4203-a063-ff48117e360c tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:41.489790 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-33169e63-d5a4-4203-a063-ff48117e360c tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:41.490749 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-33169e63-d5a4-4203-a063-ff48117e360c tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:41.491185 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-33169e63-d5a4-4203-a063-ff48117e360c tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:41.637265 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-33169e63-d5a4-4203-a063-ff48117e360c tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:41.644609 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-33169e63-d5a4-4203-a063-ff48117e360c tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd" status: 200 len: 1267 microversion: 2.1 time: 0.166075 Feb 03 03:02:41.645382 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 421/809] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:41 2022] GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:41.917928 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-820c4771-a44f-4ef7-9764-4427c7ebe7a7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:02:41.918556 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-820c4771-a44f-4ef7-9764-4427c7ebe7a7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:41.924661 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-820c4771-a44f-4ef7-9764-4427c7ebe7a7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:41.925152 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-820c4771-a44f-4ef7-9764-4427c7ebe7a7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:41.925918 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-820c4771-a44f-4ef7-9764-4427c7ebe7a7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:41.926345 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-820c4771-a44f-4ef7-9764-4427c7ebe7a7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:41.948975 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.objects.instance [None req-820c4771-a44f-4ef7-9764-4427c7ebe7a7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lazy-loading 'flavor' on Instance uuid 26d795a9-10f4-4812-9284-3b056987c2b4 {{(pid=116385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 03 03:02:42.214375 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-820c4771-a44f-4ef7-9764-4427c7ebe7a7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "POST /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4/action" status: 202 len: 0 microversion: 2.20 time: 0.300453 Feb 03 03:02:42.218492 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 389/810] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Feb 3 03:02:41 2022] POST /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 03 03:02:42.224495 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-77b208ef-e171-49a7-b055-02ba7068af72 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:42.225138 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-77b208ef-e171-49a7-b055-02ba7068af72 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:42.231670 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-77b208ef-e171-49a7-b055-02ba7068af72 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:42.232168 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-77b208ef-e171-49a7-b055-02ba7068af72 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:42.233020 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-77b208ef-e171-49a7-b055-02ba7068af72 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:42.233415 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-77b208ef-e171-49a7-b055-02ba7068af72 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:42.368180 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-77b208ef-e171-49a7-b055-02ba7068af72 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:42.376067 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-77b208ef-e171-49a7-b055-02ba7068af72 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:42.377640 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-77b208ef-e171-49a7-b055-02ba7068af72 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:42.378888 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-77b208ef-e171-49a7-b055-02ba7068af72 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1724 microversion: 2.20 time: 0.159435 Feb 03 03:02:42.379452 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 422/811] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:02:42 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:02:42.663547 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-f1f0183d-89eb-4dd3-a1e6-0b6df61d17b0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:42.664238 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-f1f0183d-89eb-4dd3-a1e6-0b6df61d17b0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 4cbae628-c830-4c00-9f73-83e7b4902acd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:42.671145 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f1f0183d-89eb-4dd3-a1e6-0b6df61d17b0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:42.671590 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f1f0183d-89eb-4dd3-a1e6-0b6df61d17b0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:42.672424 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f1f0183d-89eb-4dd3-a1e6-0b6df61d17b0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:42.672895 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f1f0183d-89eb-4dd3-a1e6-0b6df61d17b0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:42.832517 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-f1f0183d-89eb-4dd3-a1e6-0b6df61d17b0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:42.840073 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-f1f0183d-89eb-4dd3-a1e6-0b6df61d17b0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd" status: 200 len: 1267 microversion: 2.1 time: 0.181464 Feb 03 03:02:42.840643 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 390/812] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:42 2022] GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:43.398089 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-6934ba55-d66b-49e7-b2b0-9273ccde2f03 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:43.398666 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-6934ba55-d66b-49e7-b2b0-9273ccde2f03 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:43.405283 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6934ba55-d66b-49e7-b2b0-9273ccde2f03 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:43.405716 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6934ba55-d66b-49e7-b2b0-9273ccde2f03 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:43.406478 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6934ba55-d66b-49e7-b2b0-9273ccde2f03 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:43.406901 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6934ba55-d66b-49e7-b2b0-9273ccde2f03 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:43.542359 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-6934ba55-d66b-49e7-b2b0-9273ccde2f03 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:43.550713 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-6934ba55-d66b-49e7-b2b0-9273ccde2f03 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:43.552273 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-6934ba55-d66b-49e7-b2b0-9273ccde2f03 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:43.553531 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-6934ba55-d66b-49e7-b2b0-9273ccde2f03 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1724 microversion: 2.20 time: 0.159182 Feb 03 03:02:43.554157 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 423/813] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:02:43 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:02:43.856269 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-f701bb8f-f685-4359-881d-5cbc742937d4 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:43.856908 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-f701bb8f-f685-4359-881d-5cbc742937d4 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 4cbae628-c830-4c00-9f73-83e7b4902acd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:43.863496 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f701bb8f-f685-4359-881d-5cbc742937d4 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:43.863931 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f701bb8f-f685-4359-881d-5cbc742937d4 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:43.864693 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f701bb8f-f685-4359-881d-5cbc742937d4 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:43.865184 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f701bb8f-f685-4359-881d-5cbc742937d4 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:44.001414 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-f701bb8f-f685-4359-881d-5cbc742937d4 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:44.009150 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-f701bb8f-f685-4359-881d-5cbc742937d4 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd" status: 200 len: 1455 microversion: 2.1 time: 0.156538 Feb 03 03:02:44.009689 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 391/814] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:43 2022] GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd => generated 1455 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:44.024526 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-2010984c-301b-4ff5-86fb-7d6652ea0fb0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:44.025268 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-2010984c-301b-4ff5-86fb-7d6652ea0fb0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 4cbae628-c830-4c00-9f73-83e7b4902acd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:44.031203 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2010984c-301b-4ff5-86fb-7d6652ea0fb0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:44.031648 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2010984c-301b-4ff5-86fb-7d6652ea0fb0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:44.032455 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2010984c-301b-4ff5-86fb-7d6652ea0fb0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:44.032872 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2010984c-301b-4ff5-86fb-7d6652ea0fb0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:44.172140 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-2010984c-301b-4ff5-86fb-7d6652ea0fb0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:44.179546 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-2010984c-301b-4ff5-86fb-7d6652ea0fb0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd" status: 200 len: 1455 microversion: 2.1 time: 0.158575 Feb 03 03:02:44.180127 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 424/815] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:02:44 2022] GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd => generated 1455 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:02:44.572794 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-3f09bb7d-def1-498b-abde-e7b515f9738d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:44.573412 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-3f09bb7d-def1-498b-abde-e7b515f9738d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:44.579600 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3f09bb7d-def1-498b-abde-e7b515f9738d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:44.580034 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3f09bb7d-def1-498b-abde-e7b515f9738d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:44.580829 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3f09bb7d-def1-498b-abde-e7b515f9738d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:44.581254 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3f09bb7d-def1-498b-abde-e7b515f9738d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:44.833707 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-3f09bb7d-def1-498b-abde-e7b515f9738d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:44.844190 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-3f09bb7d-def1-498b-abde-e7b515f9738d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:44.851056 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-3f09bb7d-def1-498b-abde-e7b515f9738d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:44.852226 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-3f09bb7d-def1-498b-abde-e7b515f9738d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1724 microversion: 2.20 time: 0.283937 Feb 03 03:02:44.855024 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 392/816] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:02:44 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1724 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:02:45.871019 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-94ef05d9-f0bc-4e72-94f5-e8674d6c6e6c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:45.871628 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-94ef05d9-f0bc-4e72-94f5-e8674d6c6e6c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:45.878048 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-94ef05d9-f0bc-4e72-94f5-e8674d6c6e6c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:45.878499 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-94ef05d9-f0bc-4e72-94f5-e8674d6c6e6c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:45.879278 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-94ef05d9-f0bc-4e72-94f5-e8674d6c6e6c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:45.879711 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-94ef05d9-f0bc-4e72-94f5-e8674d6c6e6c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:46.156273 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-94ef05d9-f0bc-4e72-94f5-e8674d6c6e6c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:46.165115 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-94ef05d9-f0bc-4e72-94f5-e8674d6c6e6c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:46.167032 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-94ef05d9-f0bc-4e72-94f5-e8674d6c6e6c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:46.168252 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-94ef05d9-f0bc-4e72-94f5-e8674d6c6e6c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1724 microversion: 2.20 time: 0.301077 Feb 03 03:02:46.169231 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 425/817] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:02:45 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:02:46.474717 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-4d4ec911-ea71-4456-92c6-d478abc50620 req-a6330cd4-50f3-44a2-aa47-50fa2904c22a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cbae628-c830-4c00-9f73-83e7b4902acd", "tag": "5c0fa8f4-c18a-48b0-aa0e-25cfceb29350"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:02:46.476364 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:02:46.476364 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:02:46.484012 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-4d4ec911-ea71-4456-92c6-d478abc50620 req-a6330cd4-50f3-44a2-aa47-50fa2904c22a service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:46.484454 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-4d4ec911-ea71-4456-92c6-d478abc50620 req-a6330cd4-50f3-44a2-aa47-50fa2904c22a service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:46.495350 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-4d4ec911-ea71-4456-92c6-d478abc50620 req-a6330cd4-50f3-44a2-aa47-50fa2904c22a service nova] Creating event network-changed:5c0fa8f4-c18a-48b0-aa0e-25cfceb29350 for instance 4cbae628-c830-4c00-9f73-83e7b4902acd on hv-cinder-82758 Feb 03 03:02:46.500399 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-4d4ec911-ea71-4456-92c6-d478abc50620 req-a6330cd4-50f3-44a2-aa47-50fa2904c22a service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030073 Feb 03 03:02:46.501257 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 393/818] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:02:47.187141 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-42157c7b-eb80-4185-bb7d-8b792402504c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:47.187748 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-42157c7b-eb80-4185-bb7d-8b792402504c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:47.194531 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-42157c7b-eb80-4185-bb7d-8b792402504c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:47.194971 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-42157c7b-eb80-4185-bb7d-8b792402504c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:47.196132 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-42157c7b-eb80-4185-bb7d-8b792402504c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:47.196619 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-42157c7b-eb80-4185-bb7d-8b792402504c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:47.333110 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-42157c7b-eb80-4185-bb7d-8b792402504c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:47.341078 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-42157c7b-eb80-4185-bb7d-8b792402504c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:47.342561 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-42157c7b-eb80-4185-bb7d-8b792402504c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:47.343703 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-42157c7b-eb80-4185-bb7d-8b792402504c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1724 microversion: 2.20 time: 0.160894 Feb 03 03:02:47.344270 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 426/819] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:02:47 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:02:48.362745 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-8f74aaeb-1d60-4f98-938b-66552d6b70d4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:48.363419 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-8f74aaeb-1d60-4f98-938b-66552d6b70d4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:48.369402 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8f74aaeb-1d60-4f98-938b-66552d6b70d4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:48.369842 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8f74aaeb-1d60-4f98-938b-66552d6b70d4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:48.370696 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8f74aaeb-1d60-4f98-938b-66552d6b70d4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:48.371119 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8f74aaeb-1d60-4f98-938b-66552d6b70d4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:48.505997 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-8f74aaeb-1d60-4f98-938b-66552d6b70d4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:48.514295 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-8f74aaeb-1d60-4f98-938b-66552d6b70d4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:48.515960 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-8f74aaeb-1d60-4f98-938b-66552d6b70d4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:48.517172 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-8f74aaeb-1d60-4f98-938b-66552d6b70d4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1724 microversion: 2.20 time: 0.159006 Feb 03 03:02:48.517706 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 394/820] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:02:48 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:02:49.537063 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-e7b2a9c4-71dc-412d-b740-82e3896a4b7a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:49.537903 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-e7b2a9c4-71dc-412d-b740-82e3896a4b7a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:49.545899 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e7b2a9c4-71dc-412d-b740-82e3896a4b7a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:49.546340 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e7b2a9c4-71dc-412d-b740-82e3896a4b7a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:49.547110 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e7b2a9c4-71dc-412d-b740-82e3896a4b7a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:49.547536 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e7b2a9c4-71dc-412d-b740-82e3896a4b7a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:49.692405 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-e7b2a9c4-71dc-412d-b740-82e3896a4b7a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:49.700784 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-e7b2a9c4-71dc-412d-b740-82e3896a4b7a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:49.702104 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-e7b2a9c4-71dc-412d-b740-82e3896a4b7a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:49.703273 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-e7b2a9c4-71dc-412d-b740-82e3896a4b7a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1724 microversion: 2.20 time: 0.172379 Feb 03 03:02:49.703825 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 427/821] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:02:49 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:02:50.722015 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-b05ff1eb-21ba-4e3a-8f65-3bcd83698b55 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:50.722733 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-b05ff1eb-21ba-4e3a-8f65-3bcd83698b55 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:50.728931 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b05ff1eb-21ba-4e3a-8f65-3bcd83698b55 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:50.729408 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b05ff1eb-21ba-4e3a-8f65-3bcd83698b55 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:50.730398 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b05ff1eb-21ba-4e3a-8f65-3bcd83698b55 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:50.730999 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b05ff1eb-21ba-4e3a-8f65-3bcd83698b55 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:50.878061 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-b05ff1eb-21ba-4e3a-8f65-3bcd83698b55 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:50.886460 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-b05ff1eb-21ba-4e3a-8f65-3bcd83698b55 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:50.888257 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-b05ff1eb-21ba-4e3a-8f65-3bcd83698b55 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:50.889518 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-b05ff1eb-21ba-4e3a-8f65-3bcd83698b55 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1724 microversion: 2.20 time: 0.172162 Feb 03 03:02:50.890140 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 395/822] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:02:50 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:02:51.907589 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-c7846a3e-0d8a-4c28-bcf5-60be562cf6ac tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:51.908880 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-c7846a3e-0d8a-4c28-bcf5-60be562cf6ac tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:51.915265 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c7846a3e-0d8a-4c28-bcf5-60be562cf6ac tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:51.915700 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c7846a3e-0d8a-4c28-bcf5-60be562cf6ac tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:51.916506 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c7846a3e-0d8a-4c28-bcf5-60be562cf6ac tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:51.917099 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c7846a3e-0d8a-4c28-bcf5-60be562cf6ac tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:52.062744 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-c7846a3e-0d8a-4c28-bcf5-60be562cf6ac tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:52.071855 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-c7846a3e-0d8a-4c28-bcf5-60be562cf6ac tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:52.073652 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-c7846a3e-0d8a-4c28-bcf5-60be562cf6ac tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:52.075523 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-c7846a3e-0d8a-4c28-bcf5-60be562cf6ac tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1724 microversion: 2.20 time: 0.171746 Feb 03 03:02:52.076071 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 428/823] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:02:51 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:02:53.094419 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-5b697bce-62e4-4606-a54f-2ba4a4a2382e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:53.095027 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-5b697bce-62e4-4606-a54f-2ba4a4a2382e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:53.102060 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5b697bce-62e4-4606-a54f-2ba4a4a2382e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:53.102504 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5b697bce-62e4-4606-a54f-2ba4a4a2382e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:53.103283 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5b697bce-62e4-4606-a54f-2ba4a4a2382e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:53.103716 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5b697bce-62e4-4606-a54f-2ba4a4a2382e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:53.241227 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-5b697bce-62e4-4606-a54f-2ba4a4a2382e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:53.249972 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-5b697bce-62e4-4606-a54f-2ba4a4a2382e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:53.251467 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-5b697bce-62e4-4606-a54f-2ba4a4a2382e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:53.252620 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-5b697bce-62e4-4606-a54f-2ba4a4a2382e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1724 microversion: 2.20 time: 0.161964 Feb 03 03:02:53.253210 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 396/824] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:02:53 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:02:54.277327 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-c5bd20ed-7644-405c-8f28-f4d0fa5922f5 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:54.277959 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-c5bd20ed-7644-405c-8f28-f4d0fa5922f5 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:54.284690 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c5bd20ed-7644-405c-8f28-f4d0fa5922f5 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:54.285181 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c5bd20ed-7644-405c-8f28-f4d0fa5922f5 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:54.285966 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c5bd20ed-7644-405c-8f28-f4d0fa5922f5 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:54.286429 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c5bd20ed-7644-405c-8f28-f4d0fa5922f5 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:54.423648 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-c5bd20ed-7644-405c-8f28-f4d0fa5922f5 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:54.431652 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-c5bd20ed-7644-405c-8f28-f4d0fa5922f5 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:54.433265 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-c5bd20ed-7644-405c-8f28-f4d0fa5922f5 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:54.434419 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-c5bd20ed-7644-405c-8f28-f4d0fa5922f5 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1724 microversion: 2.20 time: 0.163082 Feb 03 03:02:54.434994 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 429/825] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:02:54 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:02:55.461964 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-e61a1a5e-f3f1-4377-b000-bfc8e51c8341 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:55.462885 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-e61a1a5e-f3f1-4377-b000-bfc8e51c8341 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:55.473950 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e61a1a5e-f3f1-4377-b000-bfc8e51c8341 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:55.474678 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e61a1a5e-f3f1-4377-b000-bfc8e51c8341 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:55.475972 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e61a1a5e-f3f1-4377-b000-bfc8e51c8341 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:55.476649 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e61a1a5e-f3f1-4377-b000-bfc8e51c8341 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:55.616785 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-e61a1a5e-f3f1-4377-b000-bfc8e51c8341 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:55.628043 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-e61a1a5e-f3f1-4377-b000-bfc8e51c8341 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:55.630075 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-e61a1a5e-f3f1-4377-b000-bfc8e51c8341 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:55.632366 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-e61a1a5e-f3f1-4377-b000-bfc8e51c8341 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1724 microversion: 2.20 time: 0.175967 Feb 03 03:02:55.633207 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 397/826] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:02:55 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:02:56.656398 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-4c573ed4-a3c5-4275-9e7c-f84dd3a7f670 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:56.657036 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-4c573ed4-a3c5-4275-9e7c-f84dd3a7f670 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:56.663855 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4c573ed4-a3c5-4275-9e7c-f84dd3a7f670 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:56.664307 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4c573ed4-a3c5-4275-9e7c-f84dd3a7f670 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:56.665216 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4c573ed4-a3c5-4275-9e7c-f84dd3a7f670 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:56.665674 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4c573ed4-a3c5-4275-9e7c-f84dd3a7f670 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:56.806445 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-4c573ed4-a3c5-4275-9e7c-f84dd3a7f670 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:56.814707 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-4c573ed4-a3c5-4275-9e7c-f84dd3a7f670 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:56.816184 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-4c573ed4-a3c5-4275-9e7c-f84dd3a7f670 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:56.817394 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-4c573ed4-a3c5-4275-9e7c-f84dd3a7f670 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1724 microversion: 2.20 time: 0.164741 Feb 03 03:02:56.817951 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 430/827] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:02:56 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:02:57.835938 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-cd5f0a98-a210-4729-b5f5-7179f60a24aa tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:57.836542 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-cd5f0a98-a210-4729-b5f5-7179f60a24aa tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:57.843705 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-cd5f0a98-a210-4729-b5f5-7179f60a24aa tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:57.844084 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-cd5f0a98-a210-4729-b5f5-7179f60a24aa tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:57.844886 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-cd5f0a98-a210-4729-b5f5-7179f60a24aa tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:57.845310 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-cd5f0a98-a210-4729-b5f5-7179f60a24aa tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:57.980388 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-cd5f0a98-a210-4729-b5f5-7179f60a24aa tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:57.989021 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-cd5f0a98-a210-4729-b5f5-7179f60a24aa tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:57.990483 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-cd5f0a98-a210-4729-b5f5-7179f60a24aa tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:57.991621 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-cd5f0a98-a210-4729-b5f5-7179f60a24aa tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1724 microversion: 2.20 time: 0.159494 Feb 03 03:02:57.992178 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 398/828] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:02:57 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:02:59.010635 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-01a52de0-ac92-4e60-8de9-f6a9c030fd7e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:02:59.011269 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-01a52de0-ac92-4e60-8de9-f6a9c030fd7e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:02:59.017439 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-01a52de0-ac92-4e60-8de9-f6a9c030fd7e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:59.017878 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-01a52de0-ac92-4e60-8de9-f6a9c030fd7e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:59.018642 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-01a52de0-ac92-4e60-8de9-f6a9c030fd7e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:02:59.019066 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-01a52de0-ac92-4e60-8de9-f6a9c030fd7e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:02:59.167671 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-01a52de0-ac92-4e60-8de9-f6a9c030fd7e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:59.175917 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-01a52de0-ac92-4e60-8de9-f6a9c030fd7e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:59.177389 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-01a52de0-ac92-4e60-8de9-f6a9c030fd7e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:02:59.178523 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-01a52de0-ac92-4e60-8de9-f6a9c030fd7e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1724 microversion: 2.20 time: 0.171881 Feb 03 03:02:59.179079 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 431/829] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:02:59 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:03:00.196435 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-bbf06b36-9edd-41b9-be22-da67aeb690fd tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:00.197063 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-bbf06b36-9edd-41b9-be22-da67aeb690fd tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:00.203718 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bbf06b36-9edd-41b9-be22-da67aeb690fd tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:00.204143 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bbf06b36-9edd-41b9-be22-da67aeb690fd tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:00.205101 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bbf06b36-9edd-41b9-be22-da67aeb690fd tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:00.205488 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bbf06b36-9edd-41b9-be22-da67aeb690fd tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:00.343913 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-bbf06b36-9edd-41b9-be22-da67aeb690fd tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:00.352847 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-bbf06b36-9edd-41b9-be22-da67aeb690fd tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:00.355725 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-bbf06b36-9edd-41b9-be22-da67aeb690fd tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:00.357090 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-bbf06b36-9edd-41b9-be22-da67aeb690fd tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1724 microversion: 2.20 time: 0.164199 Feb 03 03:03:00.357749 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 399/830] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:00 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:03:01.375107 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-0ddacd4e-6bb2-4a42-b085-f8536efad0fc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:01.375699 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-0ddacd4e-6bb2-4a42-b085-f8536efad0fc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:01.382427 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0ddacd4e-6bb2-4a42-b085-f8536efad0fc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:01.382874 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0ddacd4e-6bb2-4a42-b085-f8536efad0fc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:01.383718 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0ddacd4e-6bb2-4a42-b085-f8536efad0fc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:01.384133 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0ddacd4e-6bb2-4a42-b085-f8536efad0fc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:01.523237 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-0ddacd4e-6bb2-4a42-b085-f8536efad0fc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:01.531490 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-0ddacd4e-6bb2-4a42-b085-f8536efad0fc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:01.533007 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-0ddacd4e-6bb2-4a42-b085-f8536efad0fc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:01.534174 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-0ddacd4e-6bb2-4a42-b085-f8536efad0fc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1724 microversion: 2.20 time: 0.162829 Feb 03 03:03:01.534729 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 432/831] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:01 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:03:02.551404 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-3d6b298e-1104-4ad4-b965-22ea98eca154 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:02.552019 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-3d6b298e-1104-4ad4-b965-22ea98eca154 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:02.558326 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3d6b298e-1104-4ad4-b965-22ea98eca154 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:02.558770 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3d6b298e-1104-4ad4-b965-22ea98eca154 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:02.559662 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3d6b298e-1104-4ad4-b965-22ea98eca154 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:02.560096 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3d6b298e-1104-4ad4-b965-22ea98eca154 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:02.710002 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-3d6b298e-1104-4ad4-b965-22ea98eca154 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:02.719414 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-3d6b298e-1104-4ad4-b965-22ea98eca154 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:02.721379 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-3d6b298e-1104-4ad4-b965-22ea98eca154 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:02.723079 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-3d6b298e-1104-4ad4-b965-22ea98eca154 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1724 microversion: 2.20 time: 0.175030 Feb 03 03:03:02.724762 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 400/832] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:02 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:03:03.740945 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-431de9ed-9e16-4de3-9ae8-f091aa0b42d1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:03.741618 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-431de9ed-9e16-4de3-9ae8-f091aa0b42d1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:03.748405 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-431de9ed-9e16-4de3-9ae8-f091aa0b42d1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:03.748887 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-431de9ed-9e16-4de3-9ae8-f091aa0b42d1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:03.749681 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-431de9ed-9e16-4de3-9ae8-f091aa0b42d1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:03.750233 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-431de9ed-9e16-4de3-9ae8-f091aa0b42d1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:03.893220 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-431de9ed-9e16-4de3-9ae8-f091aa0b42d1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:03.901299 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-431de9ed-9e16-4de3-9ae8-f091aa0b42d1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:03.902800 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-431de9ed-9e16-4de3-9ae8-f091aa0b42d1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:03.904065 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-431de9ed-9e16-4de3-9ae8-f091aa0b42d1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1745 microversion: 2.20 time: 0.166884 Feb 03 03:03:03.904613 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 433/833] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:03 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:03:04.922061 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-71e6d63d-d547-4ca4-b995-d19f6beebb58 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:04.922667 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-71e6d63d-d547-4ca4-b995-d19f6beebb58 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:04.929084 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-71e6d63d-d547-4ca4-b995-d19f6beebb58 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:04.929530 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-71e6d63d-d547-4ca4-b995-d19f6beebb58 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:04.930309 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-71e6d63d-d547-4ca4-b995-d19f6beebb58 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:04.930738 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-71e6d63d-d547-4ca4-b995-d19f6beebb58 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:05.065956 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-71e6d63d-d547-4ca4-b995-d19f6beebb58 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:05.074556 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-71e6d63d-d547-4ca4-b995-d19f6beebb58 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:05.076128 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-71e6d63d-d547-4ca4-b995-d19f6beebb58 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:05.077456 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-71e6d63d-d547-4ca4-b995-d19f6beebb58 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1740 microversion: 2.20 time: 0.158973 Feb 03 03:03:05.078118 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 401/834] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:04 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:03:05.564480 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-ac1e0234-59ed-4897-b91c-603172edab25 req-9d8463a9-0d3f-467d-abeb-245c338f2ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d795a9-10f4-4812-9284-3b056987c2b4", "name": "network-vif-plugged", "status": "completed", "tag": "b31cace4-7041-409f-a805-55308777e17a"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:03:05.567055 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:03:05.567055 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 03:03:05.578156 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-ac1e0234-59ed-4897-b91c-603172edab25 req-9d8463a9-0d3f-467d-abeb-245c338f2ee5 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:05.584044 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-ac1e0234-59ed-4897-b91c-603172edab25 req-9d8463a9-0d3f-467d-abeb-245c338f2ee5 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:05.616009 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-ac1e0234-59ed-4897-b91c-603172edab25 req-9d8463a9-0d3f-467d-abeb-245c338f2ee5 service nova] Creating event network-vif-plugged:b31cace4-7041-409f-a805-55308777e17a for instance 26d795a9-10f4-4812-9284-3b056987c2b4 on hv-cinder-82758 Feb 03 03:03:05.624909 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-ac1e0234-59ed-4897-b91c-603172edab25 req-9d8463a9-0d3f-467d-abeb-245c338f2ee5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064334 Feb 03 03:03:05.626452 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 434/835] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:03:06.095521 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-978d2c03-c658-4c9b-88d0-e47e19a3e85f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:06.097417 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-978d2c03-c658-4c9b-88d0-e47e19a3e85f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:06.105300 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-978d2c03-c658-4c9b-88d0-e47e19a3e85f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:06.106021 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-978d2c03-c658-4c9b-88d0-e47e19a3e85f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:06.107254 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-978d2c03-c658-4c9b-88d0-e47e19a3e85f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:06.107842 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-978d2c03-c658-4c9b-88d0-e47e19a3e85f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:06.366454 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-978d2c03-c658-4c9b-88d0-e47e19a3e85f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:06.374941 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-978d2c03-c658-4c9b-88d0-e47e19a3e85f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:06.376435 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-978d2c03-c658-4c9b-88d0-e47e19a3e85f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:06.377672 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-978d2c03-c658-4c9b-88d0-e47e19a3e85f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1740 microversion: 2.20 time: 0.286224 Feb 03 03:03:06.378599 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 402/836] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:06 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1740 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:03:07.698819 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-45aa690e-5fa0-4e30-92f8-3bebd70b6c5f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:07.700082 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-45aa690e-5fa0-4e30-92f8-3bebd70b6c5f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:07.707130 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-45aa690e-5fa0-4e30-92f8-3bebd70b6c5f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:07.707915 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-45aa690e-5fa0-4e30-92f8-3bebd70b6c5f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:07.708994 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-45aa690e-5fa0-4e30-92f8-3bebd70b6c5f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:07.709856 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-45aa690e-5fa0-4e30-92f8-3bebd70b6c5f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:07.858793 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-45aa690e-5fa0-4e30-92f8-3bebd70b6c5f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:07.868356 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-45aa690e-5fa0-4e30-92f8-3bebd70b6c5f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:07.869766 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-45aa690e-5fa0-4e30-92f8-3bebd70b6c5f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:07.871153 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-45aa690e-5fa0-4e30-92f8-3bebd70b6c5f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1740 microversion: 2.20 time: 0.478844 Feb 03 03:03:07.871879 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 435/837] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:07 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1740 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:03:08.889753 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-8600f1ea-f76f-4856-9dc4-05feb555fa8f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:08.890414 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-8600f1ea-f76f-4856-9dc4-05feb555fa8f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:08.901433 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8600f1ea-f76f-4856-9dc4-05feb555fa8f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:08.902181 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8600f1ea-f76f-4856-9dc4-05feb555fa8f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:08.903148 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8600f1ea-f76f-4856-9dc4-05feb555fa8f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:08.903723 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8600f1ea-f76f-4856-9dc4-05feb555fa8f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:09.075107 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-8600f1ea-f76f-4856-9dc4-05feb555fa8f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:09.089596 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-8600f1ea-f76f-4856-9dc4-05feb555fa8f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:09.091522 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-8600f1ea-f76f-4856-9dc4-05feb555fa8f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:09.092945 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-8600f1ea-f76f-4856-9dc4-05feb555fa8f tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1740 microversion: 2.20 time: 0.206973 Feb 03 03:03:09.094153 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 403/838] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:08 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:03:10.112959 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-f370bc90-7d58-48f1-8d29-d0ed054f8d6c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:10.114182 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-f370bc90-7d58-48f1-8d29-d0ed054f8d6c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:10.121299 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f370bc90-7d58-48f1-8d29-d0ed054f8d6c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:10.121970 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f370bc90-7d58-48f1-8d29-d0ed054f8d6c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:10.122754 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f370bc90-7d58-48f1-8d29-d0ed054f8d6c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:10.123243 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f370bc90-7d58-48f1-8d29-d0ed054f8d6c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:10.309506 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-f370bc90-7d58-48f1-8d29-d0ed054f8d6c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:10.320455 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-f370bc90-7d58-48f1-8d29-d0ed054f8d6c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:10.321984 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-f370bc90-7d58-48f1-8d29-d0ed054f8d6c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:10.323392 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-f370bc90-7d58-48f1-8d29-d0ed054f8d6c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1740 microversion: 2.20 time: 0.214503 Feb 03 03:03:10.336734 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 436/839] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:10 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1740 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 03 03:03:11.343849 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-9ae1c873-e788-4f6b-9aca-13ef855ec370 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:11.345232 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-9ae1c873-e788-4f6b-9aca-13ef855ec370 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:11.352285 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9ae1c873-e788-4f6b-9aca-13ef855ec370 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:11.352899 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9ae1c873-e788-4f6b-9aca-13ef855ec370 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:11.353680 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9ae1c873-e788-4f6b-9aca-13ef855ec370 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:11.354102 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9ae1c873-e788-4f6b-9aca-13ef855ec370 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:11.518169 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-9ae1c873-e788-4f6b-9aca-13ef855ec370 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:11.526686 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-9ae1c873-e788-4f6b-9aca-13ef855ec370 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:11.528158 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-9ae1c873-e788-4f6b-9aca-13ef855ec370 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:11.529348 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-9ae1c873-e788-4f6b-9aca-13ef855ec370 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1740 microversion: 2.20 time: 0.189777 Feb 03 03:03:11.541778 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 404/840] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:11 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:03:12.550307 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-6f4c4363-1b13-4484-bfc5-d5be3d2087ca tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:12.551077 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-6f4c4363-1b13-4484-bfc5-d5be3d2087ca tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:12.558728 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6f4c4363-1b13-4484-bfc5-d5be3d2087ca tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:12.559474 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6f4c4363-1b13-4484-bfc5-d5be3d2087ca tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:12.560603 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6f4c4363-1b13-4484-bfc5-d5be3d2087ca tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:12.561322 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6f4c4363-1b13-4484-bfc5-d5be3d2087ca tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:12.722429 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-6f4c4363-1b13-4484-bfc5-d5be3d2087ca tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:12.730701 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-6f4c4363-1b13-4484-bfc5-d5be3d2087ca tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:12.732396 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-6f4c4363-1b13-4484-bfc5-d5be3d2087ca tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:12.733367 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-6f4c4363-1b13-4484-bfc5-d5be3d2087ca tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1740 microversion: 2.20 time: 0.187698 Feb 03 03:03:12.733988 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 437/841] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:12 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 03 03:03:13.753917 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-184e3705-909d-4f2c-8fbc-15d2acb51140 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:13.755196 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-184e3705-909d-4f2c-8fbc-15d2acb51140 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:13.762299 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-184e3705-909d-4f2c-8fbc-15d2acb51140 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:13.762741 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-184e3705-909d-4f2c-8fbc-15d2acb51140 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:13.763507 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-184e3705-909d-4f2c-8fbc-15d2acb51140 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:13.763931 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-184e3705-909d-4f2c-8fbc-15d2acb51140 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:13.907667 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-184e3705-909d-4f2c-8fbc-15d2acb51140 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:13.915532 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-184e3705-909d-4f2c-8fbc-15d2acb51140 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:13.917028 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-184e3705-909d-4f2c-8fbc-15d2acb51140 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:13.918383 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-184e3705-909d-4f2c-8fbc-15d2acb51140 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1740 microversion: 2.20 time: 0.168284 Feb 03 03:03:13.918936 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 405/842] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:13 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 03 03:03:14.937110 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-fdc8be76-f708-4497-9e52-a738336b35c8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:14.937718 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-fdc8be76-f708-4497-9e52-a738336b35c8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:14.944492 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fdc8be76-f708-4497-9e52-a738336b35c8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:14.944969 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fdc8be76-f708-4497-9e52-a738336b35c8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:14.945817 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fdc8be76-f708-4497-9e52-a738336b35c8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:14.946250 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fdc8be76-f708-4497-9e52-a738336b35c8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:15.174741 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-fdc8be76-f708-4497-9e52-a738336b35c8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:15.185472 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-fdc8be76-f708-4497-9e52-a738336b35c8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:15.187139 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-fdc8be76-f708-4497-9e52-a738336b35c8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:15.188433 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-fdc8be76-f708-4497-9e52-a738336b35c8 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1722 microversion: 2.20 time: 0.255105 Feb 03 03:03:15.189246 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 438/843] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:14 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:03:16.207623 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-36adf3d7-79d7-4041-b182-52b79779a331 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:16.208207 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-36adf3d7-79d7-4041-b182-52b79779a331 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:16.215285 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-36adf3d7-79d7-4041-b182-52b79779a331 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:16.215731 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-36adf3d7-79d7-4041-b182-52b79779a331 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:16.216513 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-36adf3d7-79d7-4041-b182-52b79779a331 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:16.216979 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-36adf3d7-79d7-4041-b182-52b79779a331 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:16.354613 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-36adf3d7-79d7-4041-b182-52b79779a331 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:16.362994 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-36adf3d7-79d7-4041-b182-52b79779a331 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:16.364488 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-36adf3d7-79d7-4041-b182-52b79779a331 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:16.365669 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-36adf3d7-79d7-4041-b182-52b79779a331 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1722 microversion: 2.20 time: 0.161897 Feb 03 03:03:16.366261 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 406/844] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:16 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:03:17.389299 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-fe574623-6fa5-41a8-bd05-7ab671b41f40 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:17.391155 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-fe574623-6fa5-41a8-bd05-7ab671b41f40 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:17.405388 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fe574623-6fa5-41a8-bd05-7ab671b41f40 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:17.406595 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fe574623-6fa5-41a8-bd05-7ab671b41f40 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:17.408017 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fe574623-6fa5-41a8-bd05-7ab671b41f40 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:17.408619 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fe574623-6fa5-41a8-bd05-7ab671b41f40 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:17.553098 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-fe574623-6fa5-41a8-bd05-7ab671b41f40 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:17.560674 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-4895bb66-8e0b-4cfb-83b1-4f98799bcebb req-94332269-8f3d-4762-9f62-f86d29a10c57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d795a9-10f4-4812-9284-3b056987c2b4", "name": "network-vif-unplugged", "status": "completed", "tag": "b31cace4-7041-409f-a805-55308777e17a"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:03:17.563972 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:03:17.563972 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:03:17.576749 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-fe574623-6fa5-41a8-bd05-7ab671b41f40 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:17.578217 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-fe574623-6fa5-41a8-bd05-7ab671b41f40 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:17.579365 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-fe574623-6fa5-41a8-bd05-7ab671b41f40 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1725 microversion: 2.20 time: 0.197405 Feb 03 03:03:17.580148 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 439/845] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:17 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:03:17.582284 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-4895bb66-8e0b-4cfb-83b1-4f98799bcebb req-94332269-8f3d-4762-9f62-f86d29a10c57 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:17.582717 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-4895bb66-8e0b-4cfb-83b1-4f98799bcebb req-94332269-8f3d-4762-9f62-f86d29a10c57 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:17.597088 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.compute.server_external_events [req-4895bb66-8e0b-4cfb-83b1-4f98799bcebb req-94332269-8f3d-4762-9f62-f86d29a10c57 service nova] Unable to find a host for instance 26d795a9-10f4-4812-9284-3b056987c2b4. Dropping event network-vif-unplugged {{(pid=116385) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 03 03:03:17.597376 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-b7e983d7-e168-4d6d-9e2b-5210637f61ee tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a7adb98-d9da-4b79-abfc-717ee8d60290"}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:03:17.597988 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-4895bb66-8e0b-4cfb-83b1-4f98799bcebb req-94332269-8f3d-4762-9f62-f86d29a10c57 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.041012 Feb 03 03:03:17.598639 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 407/846] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 03 03:03:17.599443 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-b7e983d7-e168-4d6d-9e2b-5210637f61ee tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:17.606268 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b7e983d7-e168-4d6d-9e2b-5210637f61ee tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:17.606637 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b7e983d7-e168-4d6d-9e2b-5210637f61ee tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:17.607417 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b7e983d7-e168-4d6d-9e2b-5210637f61ee tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:17.607847 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b7e983d7-e168-4d6d-9e2b-5210637f61ee tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:17.902861 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-b7e983d7-e168-4d6d-9e2b-5210637f61ee tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "POST /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.309798 Feb 03 03:03:17.903473 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 440/847] 10.222.0.31 () {62 vars in 1363 bytes} [Thu Feb 3 03:03:17 2022] POST /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4/os-volume_attachments => generated 188 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 03 03:03:18.018344 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-7f35b71f-e8dc-4560-bf46-70c057158006 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:18.018804 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-7f35b71f-e8dc-4560-bf46-70c057158006 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:18.025238 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7f35b71f-e8dc-4560-bf46-70c057158006 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:18.025687 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7f35b71f-e8dc-4560-bf46-70c057158006 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:18.026479 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7f35b71f-e8dc-4560-bf46-70c057158006 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:18.026899 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7f35b71f-e8dc-4560-bf46-70c057158006 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:18.263439 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-7f35b71f-e8dc-4560-bf46-70c057158006 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "DELETE /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4/os-volume_attachments/1a7adb98-d9da-4b79-abfc-717ee8d60290" status: 202 len: 0 microversion: 2.20 time: 0.248876 Feb 03 03:03:18.264069 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 408/848] 10.222.0.31 () {60 vars in 1456 bytes} [Thu Feb 3 03:03:18 2022] DELETE /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4/os-volume_attachments/1a7adb98-d9da-4b79-abfc-717ee8d60290 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 03 03:03:18.318479 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-a9c8a231-02c1-4862-85ba-bd15c15b167a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:03:18.319021 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-a9c8a231-02c1-4862-85ba-bd15c15b167a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:18.325082 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a9c8a231-02c1-4862-85ba-bd15c15b167a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:18.325515 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a9c8a231-02c1-4862-85ba-bd15c15b167a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:18.326278 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a9c8a231-02c1-4862-85ba-bd15c15b167a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:18.326709 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a9c8a231-02c1-4862-85ba-bd15c15b167a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:18.404709 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-a9c8a231-02c1-4862-85ba-bd15c15b167a tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "POST /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4/action" status: 202 len: 0 microversion: 2.20 time: 0.090199 Feb 03 03:03:18.405444 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 441/849] 10.222.0.31 () {62 vars in 1318 bytes} [Thu Feb 3 03:03:18 2022] POST /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 03 03:03:18.413573 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-9c95e62d-124f-41a0-a45a-d21c8a082177 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:18.414193 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-9c95e62d-124f-41a0-a45a-d21c8a082177 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:18.420896 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9c95e62d-124f-41a0-a45a-d21c8a082177 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:18.421348 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9c95e62d-124f-41a0-a45a-d21c8a082177 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:18.422134 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9c95e62d-124f-41a0-a45a-d21c8a082177 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:18.422564 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9c95e62d-124f-41a0-a45a-d21c8a082177 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:18.562399 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-9c95e62d-124f-41a0-a45a-d21c8a082177 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:18.571140 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-9c95e62d-124f-41a0-a45a-d21c8a082177 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:18.572810 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-9c95e62d-124f-41a0-a45a-d21c8a082177 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:18.574007 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-9c95e62d-124f-41a0-a45a-d21c8a082177 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1673 microversion: 2.20 time: 0.164312 Feb 03 03:03:18.574563 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 409/850] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:18 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 03 03:03:19.592551 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-ebbcb941-a033-4c7a-99d0-9bbe65eba644 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:19.593334 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-ebbcb941-a033-4c7a-99d0-9bbe65eba644 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:19.600385 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ebbcb941-a033-4c7a-99d0-9bbe65eba644 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:19.601024 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ebbcb941-a033-4c7a-99d0-9bbe65eba644 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:19.601976 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ebbcb941-a033-4c7a-99d0-9bbe65eba644 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:19.602507 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ebbcb941-a033-4c7a-99d0-9bbe65eba644 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:19.853787 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-ebbcb941-a033-4c7a-99d0-9bbe65eba644 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:19.864364 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-ebbcb941-a033-4c7a-99d0-9bbe65eba644 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:19.865955 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-ebbcb941-a033-4c7a-99d0-9bbe65eba644 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:19.867296 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-ebbcb941-a033-4c7a-99d0-9bbe65eba644 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1731 microversion: 2.20 time: 0.279047 Feb 03 03:03:19.867858 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 442/851] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:19 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1731 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:03:20.887273 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-73e3ebbb-7d66-465a-a027-749d519e8362 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:20.888811 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-73e3ebbb-7d66-465a-a027-749d519e8362 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:20.895395 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-73e3ebbb-7d66-465a-a027-749d519e8362 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:20.896171 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-73e3ebbb-7d66-465a-a027-749d519e8362 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:20.897230 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-73e3ebbb-7d66-465a-a027-749d519e8362 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:20.897889 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-73e3ebbb-7d66-465a-a027-749d519e8362 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:21.043654 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-73e3ebbb-7d66-465a-a027-749d519e8362 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:21.051927 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-73e3ebbb-7d66-465a-a027-749d519e8362 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:21.053509 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-73e3ebbb-7d66-465a-a027-749d519e8362 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:21.055012 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-73e3ebbb-7d66-465a-a027-749d519e8362 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1731 microversion: 2.20 time: 0.172522 Feb 03 03:03:21.056166 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 410/852] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:20 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:03:22.075852 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-4ec90662-27d0-43c6-a593-330ce4396ec6 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:22.076392 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-4ec90662-27d0-43c6-a593-330ce4396ec6 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:22.086427 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4ec90662-27d0-43c6-a593-330ce4396ec6 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:22.086427 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4ec90662-27d0-43c6-a593-330ce4396ec6 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:22.087095 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4ec90662-27d0-43c6-a593-330ce4396ec6 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:22.087602 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4ec90662-27d0-43c6-a593-330ce4396ec6 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:22.239785 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-4ec90662-27d0-43c6-a593-330ce4396ec6 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:22.248162 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-4ec90662-27d0-43c6-a593-330ce4396ec6 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:22.249978 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-4ec90662-27d0-43c6-a593-330ce4396ec6 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:22.251503 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-4ec90662-27d0-43c6-a593-330ce4396ec6 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1731 microversion: 2.20 time: 0.179443 Feb 03 03:03:22.252899 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 443/853] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:22 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:03:23.270111 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-f4b741ea-5990-47e8-b9ec-79a55a904efd tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:23.271685 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-f4b741ea-5990-47e8-b9ec-79a55a904efd tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:23.279006 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f4b741ea-5990-47e8-b9ec-79a55a904efd tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:23.279444 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f4b741ea-5990-47e8-b9ec-79a55a904efd tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:23.280227 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f4b741ea-5990-47e8-b9ec-79a55a904efd tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:23.280652 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f4b741ea-5990-47e8-b9ec-79a55a904efd tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:23.416753 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-f4b741ea-5990-47e8-b9ec-79a55a904efd tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:23.425143 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-f4b741ea-5990-47e8-b9ec-79a55a904efd tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:23.426599 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-f4b741ea-5990-47e8-b9ec-79a55a904efd tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:23.427730 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-f4b741ea-5990-47e8-b9ec-79a55a904efd tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1731 microversion: 2.20 time: 0.161859 Feb 03 03:03:23.428290 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 411/854] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:23 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:03:24.446162 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-d056f484-99f1-4b08-a4ff-0cd2e39c79f6 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:24.446779 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-d056f484-99f1-4b08-a4ff-0cd2e39c79f6 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:24.453784 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d056f484-99f1-4b08-a4ff-0cd2e39c79f6 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:24.454224 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d056f484-99f1-4b08-a4ff-0cd2e39c79f6 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:24.455017 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d056f484-99f1-4b08-a4ff-0cd2e39c79f6 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:24.455439 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d056f484-99f1-4b08-a4ff-0cd2e39c79f6 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:24.602766 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-d056f484-99f1-4b08-a4ff-0cd2e39c79f6 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:24.611016 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-d056f484-99f1-4b08-a4ff-0cd2e39c79f6 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:24.612502 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-d056f484-99f1-4b08-a4ff-0cd2e39c79f6 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:24.613722 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-d056f484-99f1-4b08-a4ff-0cd2e39c79f6 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1731 microversion: 2.20 time: 0.171788 Feb 03 03:03:24.614283 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 444/855] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:24 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:03:25.633609 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-f5e7352f-4ddf-4474-8ea9-eec8125637c4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:25.635232 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-f5e7352f-4ddf-4474-8ea9-eec8125637c4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:25.642106 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f5e7352f-4ddf-4474-8ea9-eec8125637c4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:25.642838 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f5e7352f-4ddf-4474-8ea9-eec8125637c4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:25.643822 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f5e7352f-4ddf-4474-8ea9-eec8125637c4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:25.644522 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f5e7352f-4ddf-4474-8ea9-eec8125637c4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:25.793889 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-f5e7352f-4ddf-4474-8ea9-eec8125637c4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:25.802487 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-f5e7352f-4ddf-4474-8ea9-eec8125637c4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:25.804834 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-f5e7352f-4ddf-4474-8ea9-eec8125637c4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:25.805630 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-f5e7352f-4ddf-4474-8ea9-eec8125637c4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1731 microversion: 2.20 time: 0.176797 Feb 03 03:03:25.806069 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 412/856] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:25 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:03:26.827485 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-478827fb-4372-4ed1-9913-ea58d597fd15 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:26.828550 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-478827fb-4372-4ed1-9913-ea58d597fd15 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:26.839842 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-478827fb-4372-4ed1-9913-ea58d597fd15 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:26.840644 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-478827fb-4372-4ed1-9913-ea58d597fd15 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:26.842079 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-478827fb-4372-4ed1-9913-ea58d597fd15 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:26.843315 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-478827fb-4372-4ed1-9913-ea58d597fd15 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:27.376491 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-478827fb-4372-4ed1-9913-ea58d597fd15 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:27.385206 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-478827fb-4372-4ed1-9913-ea58d597fd15 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:27.386684 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-478827fb-4372-4ed1-9913-ea58d597fd15 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:27.387848 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-478827fb-4372-4ed1-9913-ea58d597fd15 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1731 microversion: 2.20 time: 0.567187 Feb 03 03:03:27.388401 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 445/857] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:26 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1731 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:03:28.407604 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-ab7804dc-30b8-4be9-8d07-a32f0f3ee09d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:28.410691 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-ab7804dc-30b8-4be9-8d07-a32f0f3ee09d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:28.419651 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ab7804dc-30b8-4be9-8d07-a32f0f3ee09d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:28.420384 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ab7804dc-30b8-4be9-8d07-a32f0f3ee09d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:28.421615 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ab7804dc-30b8-4be9-8d07-a32f0f3ee09d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:28.422267 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ab7804dc-30b8-4be9-8d07-a32f0f3ee09d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:28.603498 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-ab7804dc-30b8-4be9-8d07-a32f0f3ee09d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:28.613503 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-ab7804dc-30b8-4be9-8d07-a32f0f3ee09d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:28.615273 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-ab7804dc-30b8-4be9-8d07-a32f0f3ee09d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:28.616636 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-ab7804dc-30b8-4be9-8d07-a32f0f3ee09d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1731 microversion: 2.20 time: 0.214233 Feb 03 03:03:28.617393 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 413/858] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:28 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1731 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:03:29.641080 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-ca335472-6bdd-4dfd-97db-3d1feb9d3e9e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:29.641718 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-ca335472-6bdd-4dfd-97db-3d1feb9d3e9e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:29.648179 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ca335472-6bdd-4dfd-97db-3d1feb9d3e9e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:29.648708 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ca335472-6bdd-4dfd-97db-3d1feb9d3e9e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:29.650015 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ca335472-6bdd-4dfd-97db-3d1feb9d3e9e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:29.650015 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ca335472-6bdd-4dfd-97db-3d1feb9d3e9e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:29.819172 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-ca335472-6bdd-4dfd-97db-3d1feb9d3e9e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:29.827162 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-ca335472-6bdd-4dfd-97db-3d1feb9d3e9e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:29.828703 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-ca335472-6bdd-4dfd-97db-3d1feb9d3e9e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:29.829938 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-ca335472-6bdd-4dfd-97db-3d1feb9d3e9e tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1731 microversion: 2.20 time: 0.198764 Feb 03 03:03:29.830562 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 446/859] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:29 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1731 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:03:30.849411 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-d5930e42-3620-4c5b-9f94-e24ed84c6a36 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:30.850038 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-d5930e42-3620-4c5b-9f94-e24ed84c6a36 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:30.855872 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d5930e42-3620-4c5b-9f94-e24ed84c6a36 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:30.856316 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d5930e42-3620-4c5b-9f94-e24ed84c6a36 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:30.857113 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d5930e42-3620-4c5b-9f94-e24ed84c6a36 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:30.857553 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d5930e42-3620-4c5b-9f94-e24ed84c6a36 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:31.097445 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-d5930e42-3620-4c5b-9f94-e24ed84c6a36 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:31.106311 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-d5930e42-3620-4c5b-9f94-e24ed84c6a36 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:31.108139 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-d5930e42-3620-4c5b-9f94-e24ed84c6a36 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:31.111305 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-d5930e42-3620-4c5b-9f94-e24ed84c6a36 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1731 microversion: 2.20 time: 0.264112 Feb 03 03:03:31.120416 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 414/860] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:30 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1731 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:03:32.129762 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-0f6f0c7b-ab8c-4a8d-958a-199c4f2f86c1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:32.132028 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-0f6f0c7b-ab8c-4a8d-958a-199c4f2f86c1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:32.142804 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0f6f0c7b-ab8c-4a8d-958a-199c4f2f86c1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:32.143465 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0f6f0c7b-ab8c-4a8d-958a-199c4f2f86c1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:32.145139 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0f6f0c7b-ab8c-4a8d-958a-199c4f2f86c1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:32.145754 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0f6f0c7b-ab8c-4a8d-958a-199c4f2f86c1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:32.358510 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-0f6f0c7b-ab8c-4a8d-958a-199c4f2f86c1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:32.370267 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-0f6f0c7b-ab8c-4a8d-958a-199c4f2f86c1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:32.372328 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-0f6f0c7b-ab8c-4a8d-958a-199c4f2f86c1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:32.373743 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-0f6f0c7b-ab8c-4a8d-958a-199c4f2f86c1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1731 microversion: 2.20 time: 0.249483 Feb 03 03:03:32.385086 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 447/861] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:32 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1731 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:03:33.393336 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-fc9fbc11-1e15-4997-bf7d-824a6e9f80a4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:33.394497 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-fc9fbc11-1e15-4997-bf7d-824a6e9f80a4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:33.403108 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fc9fbc11-1e15-4997-bf7d-824a6e9f80a4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:33.403942 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fc9fbc11-1e15-4997-bf7d-824a6e9f80a4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:33.405001 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fc9fbc11-1e15-4997-bf7d-824a6e9f80a4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:33.405680 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fc9fbc11-1e15-4997-bf7d-824a6e9f80a4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:33.600776 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-fc9fbc11-1e15-4997-bf7d-824a6e9f80a4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:33.613822 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-fc9fbc11-1e15-4997-bf7d-824a6e9f80a4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:33.615428 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-fc9fbc11-1e15-4997-bf7d-824a6e9f80a4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:33.619019 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-fc9fbc11-1e15-4997-bf7d-824a6e9f80a4 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1731 microversion: 2.20 time: 0.231379 Feb 03 03:03:33.622501 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 415/862] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:33 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1731 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:03:33.854100 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-ba052a92-19ab-4a7d-9bf8-391c371f5415 req-39d62650-0538-482f-82db-182fc4d3f99b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d795a9-10f4-4812-9284-3b056987c2b4", "name": "network-vif-plugged", "status": "completed", "tag": "b31cace4-7041-409f-a805-55308777e17a"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:03:33.856089 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:03:33.856089 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 03:03:33.869338 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-ba052a92-19ab-4a7d-9bf8-391c371f5415 req-39d62650-0538-482f-82db-182fc4d3f99b service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:33.869782 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-ba052a92-19ab-4a7d-9bf8-391c371f5415 req-39d62650-0538-482f-82db-182fc4d3f99b service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:33.884312 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-ba052a92-19ab-4a7d-9bf8-391c371f5415 req-39d62650-0538-482f-82db-182fc4d3f99b service nova] Creating event network-vif-plugged:b31cace4-7041-409f-a805-55308777e17a for instance 26d795a9-10f4-4812-9284-3b056987c2b4 on hv-cinder-82758 Feb 03 03:03:33.901116 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-ba052a92-19ab-4a7d-9bf8-391c371f5415 req-39d62650-0538-482f-82db-182fc4d3f99b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043071 Feb 03 03:03:33.902841 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 448/863] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:03:34.637655 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-ee069765-8b37-4d93-80c3-2dd3025291a9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:34.638431 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-ee069765-8b37-4d93-80c3-2dd3025291a9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:34.645582 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ee069765-8b37-4d93-80c3-2dd3025291a9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:34.646151 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ee069765-8b37-4d93-80c3-2dd3025291a9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:34.646974 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ee069765-8b37-4d93-80c3-2dd3025291a9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:34.647499 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ee069765-8b37-4d93-80c3-2dd3025291a9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:34.793481 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-ee069765-8b37-4d93-80c3-2dd3025291a9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:34.806790 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-ee069765-8b37-4d93-80c3-2dd3025291a9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:34.808273 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-ee069765-8b37-4d93-80c3-2dd3025291a9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:34.809466 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-ee069765-8b37-4d93-80c3-2dd3025291a9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1731 microversion: 2.20 time: 0.175647 Feb 03 03:03:34.810029 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 416/864] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:34 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:03:35.830351 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-4e89a3ae-bcb6-45f3-a5ff-269cf5e2fc29 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:35.830989 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-4e89a3ae-bcb6-45f3-a5ff-269cf5e2fc29 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:35.840784 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4e89a3ae-bcb6-45f3-a5ff-269cf5e2fc29 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:35.841639 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4e89a3ae-bcb6-45f3-a5ff-269cf5e2fc29 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:35.842833 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4e89a3ae-bcb6-45f3-a5ff-269cf5e2fc29 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:35.843655 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4e89a3ae-bcb6-45f3-a5ff-269cf5e2fc29 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:36.046830 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-4e89a3ae-bcb6-45f3-a5ff-269cf5e2fc29 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:36.056887 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-4e89a3ae-bcb6-45f3-a5ff-269cf5e2fc29 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:36.058889 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-4e89a3ae-bcb6-45f3-a5ff-269cf5e2fc29 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:36.060270 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-4e89a3ae-bcb6-45f3-a5ff-269cf5e2fc29 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1731 microversion: 2.20 time: 0.235281 Feb 03 03:03:36.066209 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 449/865] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:35 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1731 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 03 03:03:37.078300 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-957e1e12-8bff-43a2-aff4-7b17e1127d41 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:37.079478 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-957e1e12-8bff-43a2-aff4-7b17e1127d41 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:37.088924 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-957e1e12-8bff-43a2-aff4-7b17e1127d41 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:37.089376 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-957e1e12-8bff-43a2-aff4-7b17e1127d41 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:37.090170 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-957e1e12-8bff-43a2-aff4-7b17e1127d41 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:37.097659 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-957e1e12-8bff-43a2-aff4-7b17e1127d41 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:37.291739 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-957e1e12-8bff-43a2-aff4-7b17e1127d41 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:37.301861 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-957e1e12-8bff-43a2-aff4-7b17e1127d41 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:37.304011 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-957e1e12-8bff-43a2-aff4-7b17e1127d41 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:37.305557 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-957e1e12-8bff-43a2-aff4-7b17e1127d41 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1718 microversion: 2.20 time: 0.231154 Feb 03 03:03:37.306898 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 417/866] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:03:37 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1718 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:03:39.633691 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-ec406787-a40b-4f7b-b6a3-35f5b65e8b1f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:39.634242 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-ec406787-a40b-4f7b-b6a3-35f5b65e8b1f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:39.658836 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-9874a181-7ebc-4dd8-803b-9e1a5602c850 req-f6541f8d-aa75-4563-8a62-af81ddbd713c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76a23dfa-b676-4e5a-b50a-126b1edd49e5", "tag": "e9d2989c-2c82-4969-8caa-45dce6105669"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:03:39.661850 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:03:39.661850 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:03:39.665111 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ec406787-a40b-4f7b-b6a3-35f5b65e8b1f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:39.665567 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ec406787-a40b-4f7b-b6a3-35f5b65e8b1f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:39.666365 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ec406787-a40b-4f7b-b6a3-35f5b65e8b1f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:39.666803 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ec406787-a40b-4f7b-b6a3-35f5b65e8b1f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:39.678366 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-9874a181-7ebc-4dd8-803b-9e1a5602c850 req-f6541f8d-aa75-4563-8a62-af81ddbd713c service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:39.681271 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-9874a181-7ebc-4dd8-803b-9e1a5602c850 req-f6541f8d-aa75-4563-8a62-af81ddbd713c service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:39.728468 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-9874a181-7ebc-4dd8-803b-9e1a5602c850 req-f6541f8d-aa75-4563-8a62-af81ddbd713c service nova] Creating event network-changed:e9d2989c-2c82-4969-8caa-45dce6105669 for instance 76a23dfa-b676-4e5a-b50a-126b1edd49e5 on hv-cinder-82758 Feb 03 03:03:39.729493 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-ec406787-a40b-4f7b-b6a3-35f5b65e8b1f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Going to try to terminate instance {{(pid=116386) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 03 03:03:39.735039 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-9874a181-7ebc-4dd8-803b-9e1a5602c850 req-f6541f8d-aa75-4563-8a62-af81ddbd713c service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079705 Feb 03 03:03:39.736368 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 418/867] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:03:39.856182 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-ec406787-a40b-4f7b-b6a3-35f5b65e8b1f tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "DELETE /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 204 len: 0 microversion: 2.1 time: 0.227079 Feb 03 03:03:39.857360 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 450/868] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Feb 3 03:03:39 2022] DELETE /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 03 03:03:39.874407 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-e7aa715c-1cc0-4fde-8bd9-819d71cb1f61 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:39.877362 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-e7aa715c-1cc0-4fde-8bd9-819d71cb1f61 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:39.891653 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e7aa715c-1cc0-4fde-8bd9-819d71cb1f61 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:39.895869 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e7aa715c-1cc0-4fde-8bd9-819d71cb1f61 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:39.896835 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e7aa715c-1cc0-4fde-8bd9-819d71cb1f61 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:39.897551 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e7aa715c-1cc0-4fde-8bd9-819d71cb1f61 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:40.225776 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-e7aa715c-1cc0-4fde-8bd9-819d71cb1f61 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:40.244142 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-e7aa715c-1cc0-4fde-8bd9-819d71cb1f61 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1571 microversion: 2.1 time: 0.380704 Feb 03 03:03:40.245086 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 419/869] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:03:39 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1571 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 03:03:41.264538 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-aa72b2f6-a72b-4cfa-b32c-4b437c021ba4 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:41.265937 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-aa72b2f6-a72b-4cfa-b32c-4b437c021ba4 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:41.273245 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-aa72b2f6-a72b-4cfa-b32c-4b437c021ba4 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:41.274039 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-aa72b2f6-a72b-4cfa-b32c-4b437c021ba4 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:41.274840 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-aa72b2f6-a72b-4cfa-b32c-4b437c021ba4 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:41.275765 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-aa72b2f6-a72b-4cfa-b32c-4b437c021ba4 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:41.457939 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-aa72b2f6-a72b-4cfa-b32c-4b437c021ba4 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:41.470435 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-aa72b2f6-a72b-4cfa-b32c-4b437c021ba4 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1452 microversion: 2.1 time: 0.211879 Feb 03 03:03:41.471898 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 451/870] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:03:41 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1452 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:03:42.125363 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-011531c7-3aee-4aa5-8355-bb970550a70f req-7365584c-9335-408f-a8b0-c7407d764f95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a23dfa-b676-4e5a-b50a-126b1edd49e5", "name": "network-vif-deleted", "tag": "e9d2989c-2c82-4969-8caa-45dce6105669"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:03:42.129007 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:03:42.129007 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:03:42.140510 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-011531c7-3aee-4aa5-8355-bb970550a70f req-7365584c-9335-408f-a8b0-c7407d764f95 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:42.142483 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-011531c7-3aee-4aa5-8355-bb970550a70f req-7365584c-9335-408f-a8b0-c7407d764f95 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:42.168907 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-011531c7-3aee-4aa5-8355-bb970550a70f req-7365584c-9335-408f-a8b0-c7407d764f95 service nova] Creating event network-vif-deleted:e9d2989c-2c82-4969-8caa-45dce6105669 for instance 76a23dfa-b676-4e5a-b50a-126b1edd49e5 on hv-cinder-82758 Feb 03 03:03:42.175207 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-011531c7-3aee-4aa5-8355-bb970550a70f req-7365584c-9335-408f-a8b0-c7407d764f95 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054683 Feb 03 03:03:42.175917 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 420/871] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:03:42.490189 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-f9c71f91-31cc-4709-b21f-e6e5005743af tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:42.490861 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-f9c71f91-31cc-4709-b21f-e6e5005743af tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:42.506418 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f9c71f91-31cc-4709-b21f-e6e5005743af tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:42.506941 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f9c71f91-31cc-4709-b21f-e6e5005743af tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:42.507760 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f9c71f91-31cc-4709-b21f-e6e5005743af tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:42.508236 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f9c71f91-31cc-4709-b21f-e6e5005743af tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:42.628056 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-f9c71f91-31cc-4709-b21f-e6e5005743af tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb1f6ef4005482f8dba7efb00068639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cde077871f94db3a608b5b79c01883e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:42.642920 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-f9c71f91-31cc-4709-b21f-e6e5005743af tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 200 len: 1220 microversion: 2.1 time: 0.158123 Feb 03 03:03:42.653388 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 452/872] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:03:42 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 1220 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:03:43.670428 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-fa5eb309-b144-40ac-a324-34550b77b603 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:43.672071 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-fa5eb309-b144-40ac-a324-34550b77b603 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] [instance: 76a23dfa-b676-4e5a-b50a-126b1edd49e5] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:43.698256 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fa5eb309-b144-40ac-a324-34550b77b603 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:43.698889 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fa5eb309-b144-40ac-a324-34550b77b603 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:43.699991 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fa5eb309-b144-40ac-a324-34550b77b603 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:43.702757 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fa5eb309-b144-40ac-a324-34550b77b603 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:43.729800 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.wsgi [None req-fa5eb309-b144-40ac-a324-34550b77b603 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] HTTP exception thrown: Instance 76a23dfa-b676-4e5a-b50a-126b1edd49e5 could not be found. Feb 03 03:03:43.730410 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-fa5eb309-b144-40ac-a324-34550b77b603 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Returning 404 to user: Instance 76a23dfa-b676-4e5a-b50a-126b1edd49e5 could not be found. {{(pid=116385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 03:03:43.731645 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-fa5eb309-b144-40ac-a324-34550b77b603 tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5" status: 404 len: 111 microversion: 2.1 time: 0.068959 Feb 03 03:03:43.732799 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 421/873] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:03:43 2022] GET /compute/v2.1/servers/76a23dfa-b676-4e5a-b50a-126b1edd49e5 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 03:03:43.975468 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-4abb9a5e-6b80-4b4c-86db-9e9e7b562eec tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] Calling method '.version_select at 0x7ff99cee2280>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:44.020454 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-4abb9a5e-6b80-4b4c-86db-9e9e7b562eec tempest-TestShelveInstance-278531186 tempest-TestShelveInstance-278531186-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2139397802" status: 202 len: 0 microversion: 2.1 time: 0.050045 Feb 03 03:03:44.025938 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 453/874] 10.222.0.31 () {58 vars in 1253 bytes} [Thu Feb 3 03:03:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2139397802 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 03 03:03:49.857379 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-e81573b9-a0bb-4738-be57-114d89130d3a tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Action: 'create', calling method: .version_select at 0x7ff99cfcf550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1061946084"}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:03:49.872550 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-e81573b9-a0bb-4738-be57-114d89130d3a tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Getting quotas for project 75a68a1b96ee4033bf683db87d2c6cfc. Resources: {'key_pairs'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 03:03:49.876474 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-e81573b9-a0bb-4738-be57-114d89130d3a tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Getting quotas for user c4ba512a106549b2b072c40fd33bebcb and project 75a68a1b96ee4033bf683db87d2c6cfc. Resources: {'key_pairs'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 03:03:50.249157 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-e81573b9-a0bb-4738-be57-114d89130d3a tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Getting quotas for project 75a68a1b96ee4033bf683db87d2c6cfc. Resources: {'key_pairs'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 03:03:50.252838 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-e81573b9-a0bb-4738-be57-114d89130d3a tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Getting quotas for user c4ba512a106549b2b072c40fd33bebcb and project 75a68a1b96ee4033bf683db87d2c6cfc. Resources: {'key_pairs'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 03:03:50.266541 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-e81573b9-a0bb-4738-be57-114d89130d3a tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.412686 Feb 03 03:03:50.267241 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 422/875] 10.222.0.31 () {60 vars in 1157 bytes} [Thu Feb 3 03:03:49 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:03:50.321563 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-6444aeb4-103d-4694-9b50-50fd839a61ee tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2028496177", "imageRef": "ee6cd0c4-c1ac-4a12-a18e-734a2b74f8b4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1061946084", "networks": [{"uuid": "498b9135-fbf3-435a-8b17-a2229688881a"}]}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:03:50.381692 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.network.neutron [None req-6444aeb4-103d-4694-9b50-50fd839a61ee tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] validate_networks() for [('498b9135-fbf3-435a-8b17-a2229688881a', None, None, None, None, None)] {{(pid=116386) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 03 03:03:50.968416 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-6444aeb4-103d-4694-9b50-50fd839a61ee tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Flavor limits 0:0:0 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 03 03:03:50.968942 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-6444aeb4-103d-4694-9b50-50fd839a61ee tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Image limits 0:0:0 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 03 03:03:50.969533 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-6444aeb4-103d-4694-9b50-50fd839a61ee tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Flavor pref 0:0:0 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 03 03:03:50.970369 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-6444aeb4-103d-4694-9b50-50fd839a61ee tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Image pref 0:0:0 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 03 03:03:50.970837 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-6444aeb4-103d-4694-9b50-50fd839a61ee tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 03 03:03:50.980276 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6444aeb4-103d-4694-9b50-50fd839a61ee tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:50.980991 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6444aeb4-103d-4694-9b50-50fd839a61ee tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:50.981947 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6444aeb4-103d-4694-9b50-50fd839a61ee tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:50.982559 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6444aeb4-103d-4694-9b50-50fd839a61ee tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:51.006541 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.quota [None req-6444aeb4-103d-4694-9b50-50fd839a61ee tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Getting quotas for project 75a68a1b96ee4033bf683db87d2c6cfc. Resources: {'cores', 'ram', 'instances'} {{(pid=116386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 03:03:51.011167 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.quota [None req-6444aeb4-103d-4694-9b50-50fd839a61ee tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Getting quotas for user c4ba512a106549b2b072c40fd33bebcb and project 75a68a1b96ee4033bf683db87d2c6cfc. Resources: {'cores', 'ram', 'instances'} {{(pid=116386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 03:03:51.022471 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-6444aeb4-103d-4694-9b50-50fd839a61ee tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Going to run 1 instances... {{(pid=116386) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 03 03:03:51.024799 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-6444aeb4-103d-4694-9b50-50fd839a61ee tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ee6cd0c4-c1ac-4a12-a18e-734a2b74f8b4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 03 03:03:51.072710 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-6444aeb4-103d-4694-9b50-50fd839a61ee tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.755319 Feb 03 03:03:51.073641 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 454/876] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Feb 3 03:03:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 03 03:03:51.084226 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-33cf9e32-3248-4f45-8a89-681024f21755 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:51.084955 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-33cf9e32-3248-4f45-8a89-681024f21755 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:51.157146 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-33cf9e32-3248-4f45-8a89-681024f21755 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:51.167839 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-33cf9e32-3248-4f45-8a89-681024f21755 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1259 microversion: 2.1 time: 0.086578 Feb 03 03:03:51.169447 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 423/877] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:03:51 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1259 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:03:52.186018 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-d8b0931e-5cba-49d4-8586-982017eaa238 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:52.186701 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-d8b0931e-5cba-49d4-8586-982017eaa238 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:52.192880 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d8b0931e-5cba-49d4-8586-982017eaa238 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:52.193325 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d8b0931e-5cba-49d4-8586-982017eaa238 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:52.194146 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d8b0931e-5cba-49d4-8586-982017eaa238 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:52.194748 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d8b0931e-5cba-49d4-8586-982017eaa238 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:52.270246 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-d8b0931e-5cba-49d4-8586-982017eaa238 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:52.278760 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-d8b0931e-5cba-49d4-8586-982017eaa238 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1329 microversion: 2.1 time: 0.096899 Feb 03 03:03:52.279441 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 455/878] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:03:52 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1329 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:03:53.296417 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-f32fdd02-0b96-4d14-a950-3f18fdddb3e0 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:53.297465 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-f32fdd02-0b96-4d14-a950-3f18fdddb3e0 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:53.305807 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f32fdd02-0b96-4d14-a950-3f18fdddb3e0 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:53.306568 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f32fdd02-0b96-4d14-a950-3f18fdddb3e0 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:53.308886 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f32fdd02-0b96-4d14-a950-3f18fdddb3e0 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:53.309515 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f32fdd02-0b96-4d14-a950-3f18fdddb3e0 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:53.457179 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-f32fdd02-0b96-4d14-a950-3f18fdddb3e0 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:53.464842 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-f32fdd02-0b96-4d14-a950-3f18fdddb3e0 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1359 microversion: 2.1 time: 0.172066 Feb 03 03:03:53.465642 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 424/879] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:03:53 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:03:54.484206 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-1efea6a8-f1a1-4249-8508-17f27747b979 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:54.484883 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-1efea6a8-f1a1-4249-8508-17f27747b979 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:54.494787 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1efea6a8-f1a1-4249-8508-17f27747b979 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:54.495424 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1efea6a8-f1a1-4249-8508-17f27747b979 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:54.496498 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1efea6a8-f1a1-4249-8508-17f27747b979 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:54.497194 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1efea6a8-f1a1-4249-8508-17f27747b979 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:54.637444 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-1efea6a8-f1a1-4249-8508-17f27747b979 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:54.645137 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-1efea6a8-f1a1-4249-8508-17f27747b979 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1359 microversion: 2.1 time: 0.165888 Feb 03 03:03:54.645708 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 456/880] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:03:54 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:03:55.662262 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-80e59940-5eb0-4bc7-991d-42bcd2c4a2f7 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:55.662859 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-80e59940-5eb0-4bc7-991d-42bcd2c4a2f7 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:55.669770 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-80e59940-5eb0-4bc7-991d-42bcd2c4a2f7 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:55.670210 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-80e59940-5eb0-4bc7-991d-42bcd2c4a2f7 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:55.670998 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-80e59940-5eb0-4bc7-991d-42bcd2c4a2f7 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:55.671427 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-80e59940-5eb0-4bc7-991d-42bcd2c4a2f7 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:55.805543 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-80e59940-5eb0-4bc7-991d-42bcd2c4a2f7 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:55.816537 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-80e59940-5eb0-4bc7-991d-42bcd2c4a2f7 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1359 microversion: 2.1 time: 0.158145 Feb 03 03:03:55.817333 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 425/881] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:03:55 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:03:56.836816 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-a5840e5f-b74e-4e59-8d8a-bf9e96e07f21 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:56.838290 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-a5840e5f-b74e-4e59-8d8a-bf9e96e07f21 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:56.845630 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a5840e5f-b74e-4e59-8d8a-bf9e96e07f21 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:56.846346 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a5840e5f-b74e-4e59-8d8a-bf9e96e07f21 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:56.847134 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a5840e5f-b74e-4e59-8d8a-bf9e96e07f21 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:56.847560 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a5840e5f-b74e-4e59-8d8a-bf9e96e07f21 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:56.985301 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-a5840e5f-b74e-4e59-8d8a-bf9e96e07f21 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:56.993226 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-a5840e5f-b74e-4e59-8d8a-bf9e96e07f21 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1359 microversion: 2.1 time: 0.161414 Feb 03 03:03:56.994145 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 457/882] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:03:56 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:03:58.011230 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-f02c3547-5ecc-4a61-a501-6917158fcf62 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:58.011797 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-f02c3547-5ecc-4a61-a501-6917158fcf62 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:58.018406 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f02c3547-5ecc-4a61-a501-6917158fcf62 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:58.018849 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f02c3547-5ecc-4a61-a501-6917158fcf62 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:58.019615 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f02c3547-5ecc-4a61-a501-6917158fcf62 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:58.020040 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f02c3547-5ecc-4a61-a501-6917158fcf62 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:58.170444 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-f02c3547-5ecc-4a61-a501-6917158fcf62 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:58.178843 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-f02c3547-5ecc-4a61-a501-6917158fcf62 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1359 microversion: 2.1 time: 0.171328 Feb 03 03:03:58.180789 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 426/883] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:03:58 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:03:59.195830 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-be25633f-f885-45a3-9fa0-ad2e0277539e tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:03:59.196509 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-be25633f-f885-45a3-9fa0-ad2e0277539e tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:03:59.203577 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-be25633f-f885-45a3-9fa0-ad2e0277539e tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:59.204051 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-be25633f-f885-45a3-9fa0-ad2e0277539e tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:59.204873 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-be25633f-f885-45a3-9fa0-ad2e0277539e tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:03:59.205308 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-be25633f-f885-45a3-9fa0-ad2e0277539e tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:03:59.354357 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-be25633f-f885-45a3-9fa0-ad2e0277539e tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:03:59.361974 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-be25633f-f885-45a3-9fa0-ad2e0277539e tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1359 microversion: 2.1 time: 0.170134 Feb 03 03:03:59.362572 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 458/884] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:03:59 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:00.379700 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-c66af0fa-998c-4320-aa61-779c7ca02a1b tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:00.380280 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-c66af0fa-998c-4320-aa61-779c7ca02a1b tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:00.387403 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c66af0fa-998c-4320-aa61-779c7ca02a1b tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:00.387830 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c66af0fa-998c-4320-aa61-779c7ca02a1b tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:00.388635 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c66af0fa-998c-4320-aa61-779c7ca02a1b tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:00.389089 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c66af0fa-998c-4320-aa61-779c7ca02a1b tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:00.534604 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-c66af0fa-998c-4320-aa61-779c7ca02a1b tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:00.542507 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-c66af0fa-998c-4320-aa61-779c7ca02a1b tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1359 microversion: 2.1 time: 0.166635 Feb 03 03:04:00.543068 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 427/885] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:00 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 03:04:01.559347 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-cbc642ac-2614-457c-9641-3d587ea3f14f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:01.559977 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-cbc642ac-2614-457c-9641-3d587ea3f14f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:01.566491 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cbc642ac-2614-457c-9641-3d587ea3f14f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:01.566940 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cbc642ac-2614-457c-9641-3d587ea3f14f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:01.567686 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cbc642ac-2614-457c-9641-3d587ea3f14f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:01.568108 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cbc642ac-2614-457c-9641-3d587ea3f14f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:01.746447 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-cbc642ac-2614-457c-9641-3d587ea3f14f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:01.754730 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-cbc642ac-2614-457c-9641-3d587ea3f14f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1359 microversion: 2.1 time: 0.199013 Feb 03 03:04:01.755289 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 459/886] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:01 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:02.277210 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-27c065d3-f755-4c82-b21e-9c4fe55c2119 req-b039a94d-85be-421d-ba81-6107eaa0ee5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74a55f26-9a9c-453f-89e5-b19794d5b414", "tag": "9ec67dbd-d798-42d9-982f-ae69f4d47df6"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:04:02.279073 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:04:02.279073 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:04:02.288192 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-27c065d3-f755-4c82-b21e-9c4fe55c2119 req-b039a94d-85be-421d-ba81-6107eaa0ee5b service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:02.289241 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-27c065d3-f755-4c82-b21e-9c4fe55c2119 req-b039a94d-85be-421d-ba81-6107eaa0ee5b service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:02.304356 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-27c065d3-f755-4c82-b21e-9c4fe55c2119 req-b039a94d-85be-421d-ba81-6107eaa0ee5b service nova] Creating event network-changed:9ec67dbd-d798-42d9-982f-ae69f4d47df6 for instance 74a55f26-9a9c-453f-89e5-b19794d5b414 on hv-cinder-82758 Feb 03 03:04:02.322478 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-27c065d3-f755-4c82-b21e-9c4fe55c2119 req-b039a94d-85be-421d-ba81-6107eaa0ee5b service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049699 Feb 03 03:04:02.323410 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 428/887] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:04:02.771507 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-00b76e1f-95c0-407e-b33d-747fa31ab0d2 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:02.772148 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-00b76e1f-95c0-407e-b33d-747fa31ab0d2 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:02.780136 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-00b76e1f-95c0-407e-b33d-747fa31ab0d2 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:02.780567 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-00b76e1f-95c0-407e-b33d-747fa31ab0d2 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:02.783493 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-00b76e1f-95c0-407e-b33d-747fa31ab0d2 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:02.783960 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-00b76e1f-95c0-407e-b33d-747fa31ab0d2 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:03.320609 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-00b76e1f-95c0-407e-b33d-747fa31ab0d2 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:03.329864 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-00b76e1f-95c0-407e-b33d-747fa31ab0d2 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1359 microversion: 2.1 time: 0.562130 Feb 03 03:04:03.330702 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 460/888] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:02 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1359 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:04.349727 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-707ed698-ec14-4698-9f73-5fa51de3f6f0 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:04.350298 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-707ed698-ec14-4698-9f73-5fa51de3f6f0 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:04.357288 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-707ed698-ec14-4698-9f73-5fa51de3f6f0 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:04.357725 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-707ed698-ec14-4698-9f73-5fa51de3f6f0 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:04.358490 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-707ed698-ec14-4698-9f73-5fa51de3f6f0 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:04.358914 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-707ed698-ec14-4698-9f73-5fa51de3f6f0 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:04.516645 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-707ed698-ec14-4698-9f73-5fa51de3f6f0 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:04.524266 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-707ed698-ec14-4698-9f73-5fa51de3f6f0 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1359 microversion: 2.1 time: 0.179781 Feb 03 03:04:04.524848 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 429/889] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:04 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:05.548616 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-2dbfb490-4619-4e95-8578-988e22cabdce tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:05.549705 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-2dbfb490-4619-4e95-8578-988e22cabdce tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:05.556338 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2dbfb490-4619-4e95-8578-988e22cabdce tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:05.556875 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2dbfb490-4619-4e95-8578-988e22cabdce tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:05.557690 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2dbfb490-4619-4e95-8578-988e22cabdce tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:05.558119 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-2dbfb490-4619-4e95-8578-988e22cabdce tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:05.710134 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-2dbfb490-4619-4e95-8578-988e22cabdce tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:05.720114 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-2dbfb490-4619-4e95-8578-988e22cabdce tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1359 microversion: 2.1 time: 0.180172 Feb 03 03:04:05.720690 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 461/890] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:05 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:05.881360 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-79a6fea0-60a7-48f4-898e-24df6f62a3e9 req-d9641eb7-44bd-4d31-8eb3-45364123713e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74a55f26-9a9c-453f-89e5-b19794d5b414", "name": "network-vif-plugged", "status": "completed", "tag": "9ec67dbd-d798-42d9-982f-ae69f4d47df6"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:04:05.882967 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:04:05.882967 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:04:05.890751 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-79a6fea0-60a7-48f4-898e-24df6f62a3e9 req-d9641eb7-44bd-4d31-8eb3-45364123713e service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:05.891198 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-79a6fea0-60a7-48f4-898e-24df6f62a3e9 req-d9641eb7-44bd-4d31-8eb3-45364123713e service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:05.901969 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-79a6fea0-60a7-48f4-898e-24df6f62a3e9 req-d9641eb7-44bd-4d31-8eb3-45364123713e service nova] Creating event network-vif-plugged:9ec67dbd-d798-42d9-982f-ae69f4d47df6 for instance 74a55f26-9a9c-453f-89e5-b19794d5b414 on hv-cinder-82758 Feb 03 03:04:05.906748 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-79a6fea0-60a7-48f4-898e-24df6f62a3e9 req-d9641eb7-44bd-4d31-8eb3-45364123713e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029184 Feb 03 03:04:05.907343 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 430/891] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:04:06.740583 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-1a61929b-3575-49d8-92be-60eb2b60727e tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:06.741771 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-1a61929b-3575-49d8-92be-60eb2b60727e tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:06.752364 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1a61929b-3575-49d8-92be-60eb2b60727e tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:06.752850 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1a61929b-3575-49d8-92be-60eb2b60727e tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:06.753632 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1a61929b-3575-49d8-92be-60eb2b60727e tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:06.754052 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1a61929b-3575-49d8-92be-60eb2b60727e tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:06.890067 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-1a61929b-3575-49d8-92be-60eb2b60727e tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:06.897484 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-1a61929b-3575-49d8-92be-60eb2b60727e tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1359 microversion: 2.1 time: 0.163135 Feb 03 03:04:06.898051 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 462/892] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:06 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:07.919731 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-34aa4905-2fc7-4235-9bbb-db26d1268d43 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:07.920903 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-34aa4905-2fc7-4235-9bbb-db26d1268d43 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:07.931437 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-34aa4905-2fc7-4235-9bbb-db26d1268d43 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:07.932176 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-34aa4905-2fc7-4235-9bbb-db26d1268d43 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:07.933510 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-34aa4905-2fc7-4235-9bbb-db26d1268d43 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:07.934236 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-34aa4905-2fc7-4235-9bbb-db26d1268d43 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:08.076501 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-34aa4905-2fc7-4235-9bbb-db26d1268d43 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:08.088163 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-34aa4905-2fc7-4235-9bbb-db26d1268d43 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1549 microversion: 2.1 time: 0.175675 Feb 03 03:04:08.089084 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 431/893] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:07 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1549 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:08.107019 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-f5f07b4d-cc36-47a0-bd7e-e90f0bae83ab tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:08.107646 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-f5f07b4d-cc36-47a0-bd7e-e90f0bae83ab tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:08.114335 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f5f07b4d-cc36-47a0-bd7e-e90f0bae83ab tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:08.114800 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f5f07b4d-cc36-47a0-bd7e-e90f0bae83ab tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:08.115570 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f5f07b4d-cc36-47a0-bd7e-e90f0bae83ab tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:08.115994 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f5f07b4d-cc36-47a0-bd7e-e90f0bae83ab tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:08.250323 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-f5f07b4d-cc36-47a0-bd7e-e90f0bae83ab tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:08.257915 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-f5f07b4d-cc36-47a0-bd7e-e90f0bae83ab tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1549 microversion: 2.1 time: 0.154584 Feb 03 03:04:08.258479 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 463/894] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:08 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:08.273442 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-8aefd938-6d07-4526-851f-b985136910f2 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:08.276649 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:04:08.276649 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:04:08.277649 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-8aefd938-6d07-4526-851f-b985136910f2 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:08.278391 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-8aefd938-6d07-4526-851f-b985136910f2 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Searching by: {'deleted': False, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc'} {{(pid=116385) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 03 03:04:08.285443 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8aefd938-6d07-4526-851f-b985136910f2 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:08.285882 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8aefd938-6d07-4526-851f-b985136910f2 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:08.286680 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8aefd938-6d07-4526-851f-b985136910f2 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:08.287111 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8aefd938-6d07-4526-851f-b985136910f2 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:08.374625 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.multi_cell_list [None req-8aefd938-6d07-4526-851f-b985136910f2 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116385) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 03 03:04:08.477503 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-8aefd938-6d07-4526-851f-b985136910f2 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.207603 Feb 03 03:04:08.478077 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 432/895] 10.222.0.31 () {58 vars in 1124 bytes} [Thu Feb 3 03:04:08 2022] GET /compute/v2.1/servers => generated 343 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:04:08.488552 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-51d243a3-4282-4514-bcfc-aecb4090bf75 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:08.489178 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-51d243a3-4282-4514-bcfc-aecb4090bf75 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:08.495868 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-51d243a3-4282-4514-bcfc-aecb4090bf75 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:08.496303 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-51d243a3-4282-4514-bcfc-aecb4090bf75 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:08.497119 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-51d243a3-4282-4514-bcfc-aecb4090bf75 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:08.497542 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-51d243a3-4282-4514-bcfc-aecb4090bf75 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:08.652385 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-51d243a3-4282-4514-bcfc-aecb4090bf75 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:08.661697 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-51d243a3-4282-4514-bcfc-aecb4090bf75 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1549 microversion: 2.1 time: 0.176907 Feb 03 03:04:08.662264 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 464/896] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:08 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1549 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:10.181322 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-bb0be82e-9e93-4c83-b9c8-ebc6fa0709d4 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77b0333f-f8a1-41df-85d0-712c6fc72db3"}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:04:10.182378 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-bb0be82e-9e93-4c83-b9c8-ebc6fa0709d4 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:10.188796 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bb0be82e-9e93-4c83-b9c8-ebc6fa0709d4 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:10.189287 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bb0be82e-9e93-4c83-b9c8-ebc6fa0709d4 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:10.190197 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bb0be82e-9e93-4c83-b9c8-ebc6fa0709d4 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:10.190696 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bb0be82e-9e93-4c83-b9c8-ebc6fa0709d4 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:10.451207 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-bb0be82e-9e93-4c83-b9c8-ebc6fa0709d4 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "POST /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273583 Feb 03 03:04:10.451973 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 433/897] 10.222.0.31 () {60 vars in 1322 bytes} [Thu Feb 3 03:04:10 2022] POST /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:04:11.197217 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-240e226a-dbaf-4c02-bae6-0c1c637453f9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:11.198189 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-240e226a-dbaf-4c02-bae6-0c1c637453f9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:11.204947 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-240e226a-dbaf-4c02-bae6-0c1c637453f9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:11.205398 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-240e226a-dbaf-4c02-bae6-0c1c637453f9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:11.206179 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-240e226a-dbaf-4c02-bae6-0c1c637453f9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:11.206610 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-240e226a-dbaf-4c02-bae6-0c1c637453f9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:11.236443 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-240e226a-dbaf-4c02-bae6-0c1c637453f9 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043030 Feb 03 03:04:11.237022 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 465/898] 10.222.0.31 () {60 vars in 1342 bytes} [Thu Feb 3 03:04:11 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:11.298136 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-83412bbd-16c2-4009-beee-1e4559f21616 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:11.299133 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-83412bbd-16c2-4009-beee-1e4559f21616 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:11.307245 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-83412bbd-16c2-4009-beee-1e4559f21616 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:11.307694 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-83412bbd-16c2-4009-beee-1e4559f21616 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:11.308466 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-83412bbd-16c2-4009-beee-1e4559f21616 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:11.308942 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-83412bbd-16c2-4009-beee-1e4559f21616 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:11.333405 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-83412bbd-16c2-4009-beee-1e4559f21616 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Going to try to terminate instance {{(pid=116385) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 03 03:04:11.419026 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-83412bbd-16c2-4009-beee-1e4559f21616 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "DELETE /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 204 len: 0 microversion: 2.20 time: 0.128145 Feb 03 03:04:11.419567 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 434/899] 10.222.0.31 () {60 vars in 1279 bytes} [Thu Feb 3 03:04:11 2022] DELETE /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 03 03:04:11.427938 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-faa40f05-40e7-4daf-8aab-c4e2f56156bf tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:11.428591 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-faa40f05-40e7-4daf-8aab-c4e2f56156bf tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:11.434996 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-faa40f05-40e7-4daf-8aab-c4e2f56156bf tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:11.435438 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-faa40f05-40e7-4daf-8aab-c4e2f56156bf tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:11.436217 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-faa40f05-40e7-4daf-8aab-c4e2f56156bf tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:11.436645 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-faa40f05-40e7-4daf-8aab-c4e2f56156bf tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:11.579874 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-faa40f05-40e7-4daf-8aab-c4e2f56156bf tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:11.588282 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-faa40f05-40e7-4daf-8aab-c4e2f56156bf tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:11.590100 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-faa40f05-40e7-4daf-8aab-c4e2f56156bf tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:11.591567 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-faa40f05-40e7-4daf-8aab-c4e2f56156bf tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1724 microversion: 2.20 time: 0.167259 Feb 03 03:04:11.592239 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 466/900] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:04:11 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:04:12.611746 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-e1ca898a-39d0-4190-a66f-ebb5479b0c83 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:12.613062 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-e1ca898a-39d0-4190-a66f-ebb5479b0c83 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:12.619859 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e1ca898a-39d0-4190-a66f-ebb5479b0c83 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:12.620304 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e1ca898a-39d0-4190-a66f-ebb5479b0c83 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:12.621102 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e1ca898a-39d0-4190-a66f-ebb5479b0c83 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:12.621532 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e1ca898a-39d0-4190-a66f-ebb5479b0c83 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:12.757667 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-e1ca898a-39d0-4190-a66f-ebb5479b0c83 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:12.766256 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-e1ca898a-39d0-4190-a66f-ebb5479b0c83 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:12.767723 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-e1ca898a-39d0-4190-a66f-ebb5479b0c83 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:12.768895 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-e1ca898a-39d0-4190-a66f-ebb5479b0c83 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1724 microversion: 2.20 time: 0.161182 Feb 03 03:04:12.769453 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 435/901] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:04:12 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 03 03:04:13.763014 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-6dcac30e-ad73-4ffd-84d3-db652840fe81 req-3b4522f5-1a6c-46f7-aeb0-ed9e33649332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d795a9-10f4-4812-9284-3b056987c2b4", "name": "network-vif-deleted", "tag": "b31cace4-7041-409f-a805-55308777e17a"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:04:13.765649 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:04:13.765649 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 03:04:13.773827 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-6dcac30e-ad73-4ffd-84d3-db652840fe81 req-3b4522f5-1a6c-46f7-aeb0-ed9e33649332 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:13.774433 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-6dcac30e-ad73-4ffd-84d3-db652840fe81 req-3b4522f5-1a6c-46f7-aeb0-ed9e33649332 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:13.787883 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-06805b73-fabe-4890-8c73-b37f37a35f39 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:13.788489 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-06805b73-fabe-4890-8c73-b37f37a35f39 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:13.794688 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-6dcac30e-ad73-4ffd-84d3-db652840fe81 req-3b4522f5-1a6c-46f7-aeb0-ed9e33649332 service nova] Creating event network-vif-deleted:b31cace4-7041-409f-a805-55308777e17a for instance 26d795a9-10f4-4812-9284-3b056987c2b4 on hv-cinder-82758 Feb 03 03:04:13.802616 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-06805b73-fabe-4890-8c73-b37f37a35f39 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:13.803295 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-06805b73-fabe-4890-8c73-b37f37a35f39 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:13.804253 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-06805b73-fabe-4890-8c73-b37f37a35f39 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:13.804916 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-06805b73-fabe-4890-8c73-b37f37a35f39 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:13.809425 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-6dcac30e-ad73-4ffd-84d3-db652840fe81 req-3b4522f5-1a6c-46f7-aeb0-ed9e33649332 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050905 Feb 03 03:04:13.817816 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 467/902] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:04:13.870619 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-06805b73-fabe-4890-8c73-b37f37a35f39 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:13.880807 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-06805b73-fabe-4890-8c73-b37f37a35f39 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:13.882679 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-06805b73-fabe-4890-8c73-b37f37a35f39 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa4fbbf421f34df6b34b27f3ee5247b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8467ff017574f36b1c31db5579a56ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:13.884001 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-06805b73-fabe-4890-8c73-b37f37a35f39 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 200 len: 1367 microversion: 2.20 time: 0.100340 Feb 03 03:04:13.885068 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 436/903] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:04:13 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 1367 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 03 03:04:14.906799 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-4fd806cd-8066-4aec-a77e-bcf89a52afc1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:14.907528 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-4fd806cd-8066-4aec-a77e-bcf89a52afc1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:14.915757 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4fd806cd-8066-4aec-a77e-bcf89a52afc1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:14.916193 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4fd806cd-8066-4aec-a77e-bcf89a52afc1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:14.916980 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4fd806cd-8066-4aec-a77e-bcf89a52afc1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:14.917439 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4fd806cd-8066-4aec-a77e-bcf89a52afc1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:14.931289 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.wsgi [None req-4fd806cd-8066-4aec-a77e-bcf89a52afc1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] HTTP exception thrown: Instance 26d795a9-10f4-4812-9284-3b056987c2b4 could not be found. Feb 03 03:04:14.931795 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-4fd806cd-8066-4aec-a77e-bcf89a52afc1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Returning 404 to user: Instance 26d795a9-10f4-4812-9284-3b056987c2b4 could not be found. {{(pid=116386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 03:04:14.932601 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-4fd806cd-8066-4aec-a77e-bcf89a52afc1 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 404 len: 111 microversion: 2.20 time: 0.032845 Feb 03 03:04:14.933151 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 468/904] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:04:14 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 03 03:04:14.944053 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-436aadff-a586-4abe-8e37-98b03cee3f63 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '.version_select at 0x7ff99cf45700>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:14.966311 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-436aadff-a586-4abe-8e37-98b03cee3f63 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1964776755" status: 204 len: 0 microversion: 2.20 time: 0.028089 Feb 03 03:04:14.966877 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 437/905] 10.222.0.31 () {60 vars in 1261 bytes} [Thu Feb 3 03:04:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1964776755 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 03 03:04:16.739327 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-03652493-1db1-4a98-a7cf-348c6eabeee7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:16.739932 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-03652493-1db1-4a98-a7cf-348c6eabeee7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:16.746324 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-03652493-1db1-4a98-a7cf-348c6eabeee7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:16.746769 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-03652493-1db1-4a98-a7cf-348c6eabeee7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:16.747541 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-03652493-1db1-4a98-a7cf-348c6eabeee7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:16.747972 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-03652493-1db1-4a98-a7cf-348c6eabeee7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:16.761339 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.wsgi [None req-03652493-1db1-4a98-a7cf-348c6eabeee7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] HTTP exception thrown: Instance 26d795a9-10f4-4812-9284-3b056987c2b4 could not be found. Feb 03 03:04:16.761908 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-03652493-1db1-4a98-a7cf-348c6eabeee7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Returning 404 to user: Instance 26d795a9-10f4-4812-9284-3b056987c2b4 could not be found. {{(pid=116386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 03:04:16.762716 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-03652493-1db1-4a98-a7cf-348c6eabeee7 tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "DELETE /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 404 len: 111 microversion: 2.20 time: 0.027152 Feb 03 03:04:16.763239 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 469/906] 10.222.0.31 () {60 vars in 1279 bytes} [Thu Feb 3 03:04:16 2022] DELETE /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 03 03:04:16.771957 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-e694ce0b-58ff-4f96-b0ea-96e212b2f3dc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:16.772529 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-e694ce0b-58ff-4f96-b0ea-96e212b2f3dc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: 26d795a9-10f4-4812-9284-3b056987c2b4] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:16.779065 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e694ce0b-58ff-4f96-b0ea-96e212b2f3dc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:16.779518 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e694ce0b-58ff-4f96-b0ea-96e212b2f3dc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:16.780284 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e694ce0b-58ff-4f96-b0ea-96e212b2f3dc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:16.780732 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e694ce0b-58ff-4f96-b0ea-96e212b2f3dc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:16.793779 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.wsgi [None req-e694ce0b-58ff-4f96-b0ea-96e212b2f3dc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] HTTP exception thrown: Instance 26d795a9-10f4-4812-9284-3b056987c2b4 could not be found. Feb 03 03:04:16.794330 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-e694ce0b-58ff-4f96-b0ea-96e212b2f3dc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Returning 404 to user: Instance 26d795a9-10f4-4812-9284-3b056987c2b4 could not be found. {{(pid=116385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 03:04:16.795182 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-e694ce0b-58ff-4f96-b0ea-96e212b2f3dc tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4" status: 404 len: 111 microversion: 2.20 time: 0.027744 Feb 03 03:04:16.795726 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 438/907] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:04:16 2022] GET /compute/v2.1/servers/26d795a9-10f4-4812-9284-3b056987c2b4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Feb 03 03:04:16.920890 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-8be90ea8-1619-4945-8812-7b1a9bb7cab8 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:16.921478 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-8be90ea8-1619-4945-8812-7b1a9bb7cab8 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:16.927708 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8be90ea8-1619-4945-8812-7b1a9bb7cab8 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:16.928188 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8be90ea8-1619-4945-8812-7b1a9bb7cab8 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:16.928996 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8be90ea8-1619-4945-8812-7b1a9bb7cab8 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:16.929457 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8be90ea8-1619-4945-8812-7b1a9bb7cab8 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:17.071449 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-8be90ea8-1619-4945-8812-7b1a9bb7cab8 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:17.079561 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-8be90ea8-1619-4945-8812-7b1a9bb7cab8 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1595 microversion: 2.1 time: 0.162391 Feb 03 03:04:17.080103 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 470/908] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:16 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1595 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:17.922728 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-a5a485f4-0728-4ab5-8212-dfb51c1f134c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:17.923255 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-a5a485f4-0728-4ab5-8212-dfb51c1f134c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:17.929948 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a5a485f4-0728-4ab5-8212-dfb51c1f134c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:17.930401 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a5a485f4-0728-4ab5-8212-dfb51c1f134c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:17.931200 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a5a485f4-0728-4ab5-8212-dfb51c1f134c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:17.931626 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a5a485f4-0728-4ab5-8212-dfb51c1f134c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:17.945135 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.wsgi [None req-a5a485f4-0728-4ab5-8212-dfb51c1f134c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] HTTP exception thrown: Instance e0708ed4-206d-484e-a2b4-dfb7733d415b could not be found. Feb 03 03:04:17.945715 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-a5a485f4-0728-4ab5-8212-dfb51c1f134c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Returning 404 to user: Instance e0708ed4-206d-484e-a2b4-dfb7733d415b could not be found. {{(pid=116385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 03:04:17.946535 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-a5a485f4-0728-4ab5-8212-dfb51c1f134c tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "DELETE /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 404 len: 111 microversion: 2.20 time: 0.027569 Feb 03 03:04:17.947038 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 439/909] 10.222.0.31 () {60 vars in 1279 bytes} [Thu Feb 3 03:04:17 2022] DELETE /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 03 03:04:17.954947 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-979484a3-c957-45d1-ace7-af53bf3da12d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:17.955564 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-979484a3-c957-45d1-ace7-af53bf3da12d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] [instance: e0708ed4-206d-484e-a2b4-dfb7733d415b] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:17.962278 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-979484a3-c957-45d1-ace7-af53bf3da12d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:17.962726 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-979484a3-c957-45d1-ace7-af53bf3da12d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:17.963516 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-979484a3-c957-45d1-ace7-af53bf3da12d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:17.963938 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-979484a3-c957-45d1-ace7-af53bf3da12d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:17.977963 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.wsgi [None req-979484a3-c957-45d1-ace7-af53bf3da12d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] HTTP exception thrown: Instance e0708ed4-206d-484e-a2b4-dfb7733d415b could not be found. Feb 03 03:04:17.978472 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-979484a3-c957-45d1-ace7-af53bf3da12d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] Returning 404 to user: Instance e0708ed4-206d-484e-a2b4-dfb7733d415b could not be found. {{(pid=116386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 03:04:17.979304 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-979484a3-c957-45d1-ace7-af53bf3da12d tempest-AttachVolumeShelveTestJSON-286114139 tempest-AttachVolumeShelveTestJSON-286114139-project] 10.222.0.31 "GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b" status: 404 len: 111 microversion: 2.20 time: 0.028052 Feb 03 03:04:17.979839 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 471/910] 10.222.0.31 () {60 vars in 1276 bytes} [Thu Feb 3 03:04:17 2022] GET /compute/v2.1/servers/e0708ed4-206d-484e-a2b4-dfb7733d415b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 03 03:04:19.855104 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-d97d1fed-3855-4b70-931c-b74d135f095a req-7282e94f-4e42-44ad-b520-e9a4334aa3dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74a55f26-9a9c-453f-89e5-b19794d5b414", "tag": "9ec67dbd-d798-42d9-982f-ae69f4d47df6"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:04:19.857537 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:04:19.857537 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:04:19.865586 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-d97d1fed-3855-4b70-931c-b74d135f095a req-7282e94f-4e42-44ad-b520-e9a4334aa3dd service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:19.866348 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-d97d1fed-3855-4b70-931c-b74d135f095a req-7282e94f-4e42-44ad-b520-e9a4334aa3dd service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:19.880784 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-d97d1fed-3855-4b70-931c-b74d135f095a req-7282e94f-4e42-44ad-b520-e9a4334aa3dd service nova] Creating event network-changed:9ec67dbd-d798-42d9-982f-ae69f4d47df6 for instance 74a55f26-9a9c-453f-89e5-b19794d5b414 on hv-cinder-82758 Feb 03 03:04:19.889404 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-d97d1fed-3855-4b70-931c-b74d135f095a req-7282e94f-4e42-44ad-b520-e9a4334aa3dd service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.243459 Feb 03 03:04:19.890600 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 440/911] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:04:21.069092 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-85c2174d-b3a6-49eb-b557-2b8c4cb0ff17 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1271164535"}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:04:21.070569 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-85c2174d-b3a6-49eb-b557-2b8c4cb0ff17 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:21.077340 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-85c2174d-b3a6-49eb-b557-2b8c4cb0ff17 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:21.077793 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-85c2174d-b3a6-49eb-b557-2b8c4cb0ff17 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:21.078597 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-85c2174d-b3a6-49eb-b557-2b8c4cb0ff17 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:21.079021 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-85c2174d-b3a6-49eb-b557-2b8c4cb0ff17 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:21.239511 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.network.security_group_api [None req-85c2174d-b3a6-49eb-b557-2b8c4cb0ff17 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Adding security group 19a5db45-ca6d-4c4f-adb1-c2141ce4b05a to port 9ec67dbd-d798-42d9-982f-ae69f4d47df6 Feb 03 03:04:21.587521 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-85c2174d-b3a6-49eb-b557-2b8c4cb0ff17 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "POST /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414/action" status: 202 len: 0 microversion: 2.1 time: 0.522264 Feb 03 03:04:21.595871 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 472/912] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Feb 3 03:04:21 2022] POST /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 03 03:04:21.606577 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-6787be42-ec39-413d-b5d4-7ef82cfd49fc req-2920c8ec-deca-4b94-b6d9-22a0b1cb3d39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74a55f26-9a9c-453f-89e5-b19794d5b414", "tag": "9ec67dbd-d798-42d9-982f-ae69f4d47df6"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:04:21.608236 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:04:21.608236 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:04:21.615079 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-626400e9-0063-4d36-a21b-4acdc9a45672 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:21.615671 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-626400e9-0063-4d36-a21b-4acdc9a45672 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:21.627195 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-626400e9-0063-4d36-a21b-4acdc9a45672 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:21.632139 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-6787be42-ec39-413d-b5d4-7ef82cfd49fc req-2920c8ec-deca-4b94-b6d9-22a0b1cb3d39 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:21.635208 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-626400e9-0063-4d36-a21b-4acdc9a45672 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:21.638381 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-6787be42-ec39-413d-b5d4-7ef82cfd49fc req-2920c8ec-deca-4b94-b6d9-22a0b1cb3d39 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:21.640147 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-626400e9-0063-4d36-a21b-4acdc9a45672 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:21.641532 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-626400e9-0063-4d36-a21b-4acdc9a45672 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:21.667876 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-6787be42-ec39-413d-b5d4-7ef82cfd49fc req-2920c8ec-deca-4b94-b6d9-22a0b1cb3d39 service nova] Creating event network-changed:9ec67dbd-d798-42d9-982f-ae69f4d47df6 for instance 74a55f26-9a9c-453f-89e5-b19794d5b414 on hv-cinder-82758 Feb 03 03:04:21.677777 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-6787be42-ec39-413d-b5d4-7ef82cfd49fc req-2920c8ec-deca-4b94-b6d9-22a0b1cb3d39 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084599 Feb 03 03:04:21.682680 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 441/913] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:04:21.985835 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-626400e9-0063-4d36-a21b-4acdc9a45672 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:21.999965 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-626400e9-0063-4d36-a21b-4acdc9a45672 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1761 microversion: 2.1 time: 0.402678 Feb 03 03:04:22.001218 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 473/914] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:21 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1761 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:40.075807 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-f8a5e458-cfcc-46a8-b830-0bdc0daa81ad tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-661508075", "imageRef": "99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce", "flavorRef": "452", "networks": [{"uuid": "ee964cae-ff6f-484e-a320-b30e15c79aec"}]}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:04:40.127553 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.network.neutron [None req-f8a5e458-cfcc-46a8-b830-0bdc0daa81ad tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] validate_networks() for [('ee964cae-ff6f-484e-a320-b30e15c79aec', None, None, None, None, None)] {{(pid=116385) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 03 03:04:40.476090 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-f8a5e458-cfcc-46a8-b830-0bdc0daa81ad tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Flavor limits 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 03 03:04:40.476705 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-f8a5e458-cfcc-46a8-b830-0bdc0daa81ad tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Image limits 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 03 03:04:40.477457 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-f8a5e458-cfcc-46a8-b830-0bdc0daa81ad tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Flavor pref 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 03 03:04:40.477839 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-f8a5e458-cfcc-46a8-b830-0bdc0daa81ad tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Image pref 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 03 03:04:40.478284 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-f8a5e458-cfcc-46a8-b830-0bdc0daa81ad tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 03 03:04:40.487902 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f8a5e458-cfcc-46a8-b830-0bdc0daa81ad tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:40.488344 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f8a5e458-cfcc-46a8-b830-0bdc0daa81ad tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:40.489195 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f8a5e458-cfcc-46a8-b830-0bdc0daa81ad tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:40.489628 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f8a5e458-cfcc-46a8-b830-0bdc0daa81ad tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:40.506483 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-f8a5e458-cfcc-46a8-b830-0bdc0daa81ad tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Getting quotas for project b3c17e83a1e6491b9caecd968321a263. Resources: {'cores', 'ram', 'instances'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 03:04:40.510930 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-f8a5e458-cfcc-46a8-b830-0bdc0daa81ad tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Getting quotas for user 04c8680f685446b2b96aaea84587b7bd and project b3c17e83a1e6491b9caecd968321a263. Resources: {'cores', 'ram', 'instances'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 03:04:40.523091 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-f8a5e458-cfcc-46a8-b830-0bdc0daa81ad tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Going to run 1 instances... {{(pid=116385) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 03 03:04:40.525501 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-f8a5e458-cfcc-46a8-b830-0bdc0daa81ad tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 4e2f7d88-4b19-45a9-8e11-4b0de62052b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 03 03:04:40.567538 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f8a5e458-cfcc-46a8-b830-0bdc0daa81ad tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [554006c6-d853-4817-9511-c496f155a333] AMQP server on 10.222.0.31:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 03 03:04:41.580472 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO oslo.messaging._drivers.impl_rabbit [None req-f8a5e458-cfcc-46a8-b830-0bdc0daa81ad tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [554006c6-d853-4817-9511-c496f155a333] Reconnected to AMQP server on 10.222.0.31:5672 via [amqp] client with port 42734. Feb 03 03:04:41.587701 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-f8a5e458-cfcc-46a8-b830-0bdc0daa81ad tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.515951 Feb 03 03:04:41.588560 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 442/915] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Feb 3 03:04:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 03 03:04:41.599600 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-6f2407d1-f550-477c-aef1-40dcc89c87cf tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:41.600522 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-6f2407d1-f550-477c-aef1-40dcc89c87cf tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 4e2f7d88-4b19-45a9-8e11-4b0de62052b3] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:41.656752 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-6f2407d1-f550-477c-aef1-40dcc89c87cf tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c8680f685446b2b96aaea84587b7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c17e83a1e6491b9caecd968321a263', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:41.663708 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-6f2407d1-f550-477c-aef1-40dcc89c87cf tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "GET /compute/v2.1/servers/4e2f7d88-4b19-45a9-8e11-4b0de62052b3" status: 200 len: 1218 microversion: 2.1 time: 0.068695 Feb 03 03:04:41.664254 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 474/916] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:41 2022] GET /compute/v2.1/servers/4e2f7d88-4b19-45a9-8e11-4b0de62052b3 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:42.682633 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-c354a71f-23f5-4593-be4f-022a225ef040 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:42.683887 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-c354a71f-23f5-4593-be4f-022a225ef040 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 4e2f7d88-4b19-45a9-8e11-4b0de62052b3] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:42.695664 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c354a71f-23f5-4593-be4f-022a225ef040 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:42.696462 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c354a71f-23f5-4593-be4f-022a225ef040 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:42.697281 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c354a71f-23f5-4593-be4f-022a225ef040 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:42.697873 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c354a71f-23f5-4593-be4f-022a225ef040 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:42.765521 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-c354a71f-23f5-4593-be4f-022a225ef040 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c8680f685446b2b96aaea84587b7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c17e83a1e6491b9caecd968321a263', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:42.772637 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-c354a71f-23f5-4593-be4f-022a225ef040 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "GET /compute/v2.1/servers/4e2f7d88-4b19-45a9-8e11-4b0de62052b3" status: 200 len: 1276 microversion: 2.1 time: 0.095652 Feb 03 03:04:42.773257 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 443/917] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:42 2022] GET /compute/v2.1/servers/4e2f7d88-4b19-45a9-8e11-4b0de62052b3 => generated 1276 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:43.790082 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-a9272d85-4e57-43f2-acf5-ddb0d8f9fb76 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:43.790719 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-a9272d85-4e57-43f2-acf5-ddb0d8f9fb76 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 4e2f7d88-4b19-45a9-8e11-4b0de62052b3] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:43.798361 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a9272d85-4e57-43f2-acf5-ddb0d8f9fb76 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:43.798809 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a9272d85-4e57-43f2-acf5-ddb0d8f9fb76 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:43.799630 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a9272d85-4e57-43f2-acf5-ddb0d8f9fb76 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:43.800056 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a9272d85-4e57-43f2-acf5-ddb0d8f9fb76 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:44.105946 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-a9272d85-4e57-43f2-acf5-ddb0d8f9fb76 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c8680f685446b2b96aaea84587b7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c17e83a1e6491b9caecd968321a263', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:44.113732 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-a9272d85-4e57-43f2-acf5-ddb0d8f9fb76 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "GET /compute/v2.1/servers/4e2f7d88-4b19-45a9-8e11-4b0de62052b3" status: 200 len: 1318 microversion: 2.1 time: 0.327583 Feb 03 03:04:44.114311 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 475/918] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:43 2022] GET /compute/v2.1/servers/4e2f7d88-4b19-45a9-8e11-4b0de62052b3 => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:44.182314 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-2325fa42-8c27-4c3a-aa78-d8afd436c5ec req-277e8fb3-8d4b-4a1c-b2b2-73d6bf318d25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e2f7d88-4b19-45a9-8e11-4b0de62052b3", "tag": "7d86aab8-5c1f-4e24-814a-145bc924da52"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:04:44.184994 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:04:44.184994 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:04:44.195846 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-2325fa42-8c27-4c3a-aa78-d8afd436c5ec req-277e8fb3-8d4b-4a1c-b2b2-73d6bf318d25 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:44.196300 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-2325fa42-8c27-4c3a-aa78-d8afd436c5ec req-277e8fb3-8d4b-4a1c-b2b2-73d6bf318d25 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:44.208121 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-2325fa42-8c27-4c3a-aa78-d8afd436c5ec req-277e8fb3-8d4b-4a1c-b2b2-73d6bf318d25 service nova] Creating event network-changed:7d86aab8-5c1f-4e24-814a-145bc924da52 for instance 4e2f7d88-4b19-45a9-8e11-4b0de62052b3 on hv-cinder-82758 Feb 03 03:04:44.214119 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-2325fa42-8c27-4c3a-aa78-d8afd436c5ec req-277e8fb3-8d4b-4a1c-b2b2-73d6bf318d25 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035855 Feb 03 03:04:44.214717 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 444/919] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 03 03:04:44.619856 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-01d2cb5f-5f75-4074-b80b-1821498bc991 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:04:44.620952 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-01d2cb5f-5f75-4074-b80b-1821498bc991 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:44.627332 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-01d2cb5f-5f75-4074-b80b-1821498bc991 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:44.627779 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-01d2cb5f-5f75-4074-b80b-1821498bc991 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:44.628564 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-01d2cb5f-5f75-4074-b80b-1821498bc991 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:44.629023 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-01d2cb5f-5f75-4074-b80b-1821498bc991 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:44.708865 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-01d2cb5f-5f75-4074-b80b-1821498bc991 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "POST /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414/action" status: 202 len: 0 microversion: 2.1 time: 0.093645 Feb 03 03:04:44.712780 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 476/920] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Feb 3 03:04:44 2022] POST /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 03 03:04:44.718673 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-2487800e-f0a7-4aa8-b3ae-0c5f36ae8c17 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:44.719356 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-2487800e-f0a7-4aa8-b3ae-0c5f36ae8c17 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:44.726197 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2487800e-f0a7-4aa8-b3ae-0c5f36ae8c17 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:44.726639 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2487800e-f0a7-4aa8-b3ae-0c5f36ae8c17 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:44.727481 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2487800e-f0a7-4aa8-b3ae-0c5f36ae8c17 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:44.727908 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2487800e-f0a7-4aa8-b3ae-0c5f36ae8c17 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:44.984635 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-2487800e-f0a7-4aa8-b3ae-0c5f36ae8c17 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:44.993645 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-2487800e-f0a7-4aa8-b3ae-0c5f36ae8c17 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1753 microversion: 2.1 time: 0.279314 Feb 03 03:04:44.994212 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 445/921] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:44 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1753 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:45.131677 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-13b57354-73f0-40c4-8851-5089e43d8aea tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:45.133071 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-13b57354-73f0-40c4-8851-5089e43d8aea tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 4e2f7d88-4b19-45a9-8e11-4b0de62052b3] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:45.139260 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-13b57354-73f0-40c4-8851-5089e43d8aea tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:45.139930 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-13b57354-73f0-40c4-8851-5089e43d8aea tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:45.140733 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-13b57354-73f0-40c4-8851-5089e43d8aea tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:45.141139 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-13b57354-73f0-40c4-8851-5089e43d8aea tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:45.279905 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-13b57354-73f0-40c4-8851-5089e43d8aea tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c8680f685446b2b96aaea84587b7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c17e83a1e6491b9caecd968321a263', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:45.288927 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-13b57354-73f0-40c4-8851-5089e43d8aea tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "GET /compute/v2.1/servers/4e2f7d88-4b19-45a9-8e11-4b0de62052b3" status: 200 len: 1318 microversion: 2.1 time: 0.161801 Feb 03 03:04:45.289504 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 477/922] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:45 2022] GET /compute/v2.1/servers/4e2f7d88-4b19-45a9-8e11-4b0de62052b3 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 03:04:46.010473 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-ebe350f1-c6de-47cb-aad1-04a14dfceb8b tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:46.011854 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-ebe350f1-c6de-47cb-aad1-04a14dfceb8b tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:46.018966 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ebe350f1-c6de-47cb-aad1-04a14dfceb8b tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:46.019414 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ebe350f1-c6de-47cb-aad1-04a14dfceb8b tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:46.020201 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ebe350f1-c6de-47cb-aad1-04a14dfceb8b tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:46.020627 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ebe350f1-c6de-47cb-aad1-04a14dfceb8b tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:46.146619 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-fff095b1-de15-4f75-a27a-19c778a52352 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:46.147217 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-fff095b1-de15-4f75-a27a-19c778a52352 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 4cbae628-c830-4c00-9f73-83e7b4902acd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:46.153762 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fff095b1-de15-4f75-a27a-19c778a52352 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:46.154224 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fff095b1-de15-4f75-a27a-19c778a52352 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:46.155213 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fff095b1-de15-4f75-a27a-19c778a52352 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:46.155834 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-fff095b1-de15-4f75-a27a-19c778a52352 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:46.172494 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-ebe350f1-c6de-47cb-aad1-04a14dfceb8b tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:46.181629 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-ebe350f1-c6de-47cb-aad1-04a14dfceb8b tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1758 microversion: 2.1 time: 0.174862 Feb 03 03:04:46.182207 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 446/923] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:46 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:46.185550 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-fff095b1-de15-4f75-a27a-19c778a52352 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 4cbae628-c830-4c00-9f73-83e7b4902acd] Going to try to terminate instance {{(pid=116386) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 03 03:04:46.261301 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-fff095b1-de15-4f75-a27a-19c778a52352 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd" status: 204 len: 0 microversion: 2.1 time: 0.118048 Feb 03 03:04:46.262158 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 478/924] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Feb 3 03:04:46 2022] DELETE /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 03 03:04:46.269821 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-844390fc-145f-4be5-82fb-8c0c83a54839 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:46.270401 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-844390fc-145f-4be5-82fb-8c0c83a54839 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 4cbae628-c830-4c00-9f73-83e7b4902acd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:46.276569 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-844390fc-145f-4be5-82fb-8c0c83a54839 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:46.277050 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-844390fc-145f-4be5-82fb-8c0c83a54839 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:46.277822 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-844390fc-145f-4be5-82fb-8c0c83a54839 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:46.278250 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-844390fc-145f-4be5-82fb-8c0c83a54839 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:46.305212 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-1d07144e-0bca-41ff-a6f5-8698a5139ebf tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:46.305895 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-1d07144e-0bca-41ff-a6f5-8698a5139ebf tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 4e2f7d88-4b19-45a9-8e11-4b0de62052b3] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:46.311875 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1d07144e-0bca-41ff-a6f5-8698a5139ebf tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:46.312323 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1d07144e-0bca-41ff-a6f5-8698a5139ebf tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:46.313126 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1d07144e-0bca-41ff-a6f5-8698a5139ebf tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:46.313558 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1d07144e-0bca-41ff-a6f5-8698a5139ebf tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:46.474291 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-844390fc-145f-4be5-82fb-8c0c83a54839 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:46.482604 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-844390fc-145f-4be5-82fb-8c0c83a54839 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd" status: 200 len: 1579 microversion: 2.1 time: 0.216501 Feb 03 03:04:46.483180 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 447/925] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:46 2022] GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd => generated 1579 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 03:04:46.500483 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-1d07144e-0bca-41ff-a6f5-8698a5139ebf tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c8680f685446b2b96aaea84587b7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c17e83a1e6491b9caecd968321a263', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:46.507943 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-1d07144e-0bca-41ff-a6f5-8698a5139ebf tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "GET /compute/v2.1/servers/4e2f7d88-4b19-45a9-8e11-4b0de62052b3" status: 200 len: 1318 microversion: 2.1 time: 0.206819 Feb 03 03:04:46.508512 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 479/926] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:46 2022] GET /compute/v2.1/servers/4e2f7d88-4b19-45a9-8e11-4b0de62052b3 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:47.201727 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-76c38df6-ba83-4a31-9d38-38429a8002d2 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:47.202442 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-76c38df6-ba83-4a31-9d38-38429a8002d2 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:47.212506 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-76c38df6-ba83-4a31-9d38-38429a8002d2 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:47.212987 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-76c38df6-ba83-4a31-9d38-38429a8002d2 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:47.213762 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-76c38df6-ba83-4a31-9d38-38429a8002d2 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:47.214195 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-76c38df6-ba83-4a31-9d38-38429a8002d2 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:47.359460 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-76c38df6-ba83-4a31-9d38-38429a8002d2 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:47.370011 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-76c38df6-ba83-4a31-9d38-38429a8002d2 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1758 microversion: 2.1 time: 0.174420 Feb 03 03:04:47.370549 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 448/927] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:47 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:47.499494 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-8b86a0bd-4990-411f-a7af-8a96d43d07b4 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:47.500069 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-8b86a0bd-4990-411f-a7af-8a96d43d07b4 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 4cbae628-c830-4c00-9f73-83e7b4902acd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:47.506891 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8b86a0bd-4990-411f-a7af-8a96d43d07b4 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:47.507332 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8b86a0bd-4990-411f-a7af-8a96d43d07b4 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:47.508109 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8b86a0bd-4990-411f-a7af-8a96d43d07b4 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:47.508628 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8b86a0bd-4990-411f-a7af-8a96d43d07b4 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:47.524500 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-6ec41bfa-f147-4341-b4e3-bfd9f79a0a37 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:47.525268 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-6ec41bfa-f147-4341-b4e3-bfd9f79a0a37 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 4e2f7d88-4b19-45a9-8e11-4b0de62052b3] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:47.531394 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6ec41bfa-f147-4341-b4e3-bfd9f79a0a37 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:47.531795 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6ec41bfa-f147-4341-b4e3-bfd9f79a0a37 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:47.532565 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6ec41bfa-f147-4341-b4e3-bfd9f79a0a37 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:47.533024 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-6ec41bfa-f147-4341-b4e3-bfd9f79a0a37 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:47.708541 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-8b86a0bd-4990-411f-a7af-8a96d43d07b4 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:47.716620 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-8b86a0bd-4990-411f-a7af-8a96d43d07b4 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd" status: 200 len: 1579 microversion: 2.1 time: 0.220751 Feb 03 03:04:47.717086 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 480/928] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:47 2022] GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd => generated 1579 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:47.720351 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-6ec41bfa-f147-4341-b4e3-bfd9f79a0a37 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c8680f685446b2b96aaea84587b7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c17e83a1e6491b9caecd968321a263', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:47.728642 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-6ec41bfa-f147-4341-b4e3-bfd9f79a0a37 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "GET /compute/v2.1/servers/4e2f7d88-4b19-45a9-8e11-4b0de62052b3" status: 200 len: 1318 microversion: 2.1 time: 0.207738 Feb 03 03:04:47.729234 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 449/929] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:47 2022] GET /compute/v2.1/servers/4e2f7d88-4b19-45a9-8e11-4b0de62052b3 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:48.096457 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-b2060dd6-d5a3-4933-be69-04b683a97e8b req-3e1bf4ef-7648-483c-9ac8-40e661f5ba4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e2f7d88-4b19-45a9-8e11-4b0de62052b3", "name": "network-vif-plugged", "status": "completed", "tag": "7d86aab8-5c1f-4e24-814a-145bc924da52"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:04:48.098312 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:04:48.098312 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 03:04:48.105452 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-b2060dd6-d5a3-4933-be69-04b683a97e8b req-3e1bf4ef-7648-483c-9ac8-40e661f5ba4d service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:48.105854 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-b2060dd6-d5a3-4933-be69-04b683a97e8b req-3e1bf4ef-7648-483c-9ac8-40e661f5ba4d service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:48.117265 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-b2060dd6-d5a3-4933-be69-04b683a97e8b req-3e1bf4ef-7648-483c-9ac8-40e661f5ba4d service nova] Creating event network-vif-plugged:7d86aab8-5c1f-4e24-814a-145bc924da52 for instance 4e2f7d88-4b19-45a9-8e11-4b0de62052b3 on hv-cinder-82758 Feb 03 03:04:48.122568 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-b2060dd6-d5a3-4933-be69-04b683a97e8b req-3e1bf4ef-7648-483c-9ac8-40e661f5ba4d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030002 Feb 03 03:04:48.123442 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 481/930] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 03 03:04:48.386545 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-7fb5763e-6a77-4465-9ac5-ce3643c9c355 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:48.387104 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-7fb5763e-6a77-4465-9ac5-ce3643c9c355 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:48.393581 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7fb5763e-6a77-4465-9ac5-ce3643c9c355 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:48.394015 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7fb5763e-6a77-4465-9ac5-ce3643c9c355 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:48.394777 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7fb5763e-6a77-4465-9ac5-ce3643c9c355 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:48.395202 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7fb5763e-6a77-4465-9ac5-ce3643c9c355 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:48.551785 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-7fb5763e-6a77-4465-9ac5-ce3643c9c355 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:48.560030 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-7fb5763e-6a77-4465-9ac5-ce3643c9c355 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1758 microversion: 2.1 time: 0.177304 Feb 03 03:04:48.560651 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 450/931] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:48 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:48.734901 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-ad995aef-af50-4700-bf92-6de2549fecb8 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:48.735493 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-ad995aef-af50-4700-bf92-6de2549fecb8 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 4cbae628-c830-4c00-9f73-83e7b4902acd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:48.742174 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ad995aef-af50-4700-bf92-6de2549fecb8 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:48.742783 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ad995aef-af50-4700-bf92-6de2549fecb8 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:48.743615 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ad995aef-af50-4700-bf92-6de2549fecb8 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:48.744052 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ad995aef-af50-4700-bf92-6de2549fecb8 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:48.745671 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-5d576e7c-6f36-4a0e-8bdb-098b33f68a6a tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:48.746372 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-5d576e7c-6f36-4a0e-8bdb-098b33f68a6a tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 4e2f7d88-4b19-45a9-8e11-4b0de62052b3] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:48.752842 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5d576e7c-6f36-4a0e-8bdb-098b33f68a6a tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:48.753508 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5d576e7c-6f36-4a0e-8bdb-098b33f68a6a tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:48.754374 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5d576e7c-6f36-4a0e-8bdb-098b33f68a6a tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:48.755035 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5d576e7c-6f36-4a0e-8bdb-098b33f68a6a tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:48.859421 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-ad995aef-af50-4700-bf92-6de2549fecb8 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:48.869166 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-ad995aef-af50-4700-bf92-6de2549fecb8 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd" status: 200 len: 1511 microversion: 2.1 time: 0.138599 Feb 03 03:04:48.884473 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 482/932] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:48 2022] GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd => generated 1511 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:48.889742 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-44831202-9cf3-49e0-9f14-a3189a79d62e req-a91bce2a-6a43-4bc8-8a6e-eb1c1f3e0312 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cbae628-c830-4c00-9f73-83e7b4902acd", "name": "network-vif-deleted", "tag": "5c0fa8f4-c18a-48b0-aa0e-25cfceb29350"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:04:48.891511 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:04:48.891511 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 03:04:48.899616 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-44831202-9cf3-49e0-9f14-a3189a79d62e req-a91bce2a-6a43-4bc8-8a6e-eb1c1f3e0312 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:48.900300 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-44831202-9cf3-49e0-9f14-a3189a79d62e req-a91bce2a-6a43-4bc8-8a6e-eb1c1f3e0312 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:48.913386 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-44831202-9cf3-49e0-9f14-a3189a79d62e req-a91bce2a-6a43-4bc8-8a6e-eb1c1f3e0312 service nova] Creating event network-vif-deleted:5c0fa8f4-c18a-48b0-aa0e-25cfceb29350 for instance 4cbae628-c830-4c00-9f73-83e7b4902acd on hv-cinder-82758 Feb 03 03:04:48.919098 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-44831202-9cf3-49e0-9f14-a3189a79d62e req-a91bce2a-6a43-4bc8-8a6e-eb1c1f3e0312 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033030 Feb 03 03:04:48.920456 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 483/933] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:04:48.978292 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-5d576e7c-6f36-4a0e-8bdb-098b33f68a6a tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c8680f685446b2b96aaea84587b7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c17e83a1e6491b9caecd968321a263', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:48.986501 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-5d576e7c-6f36-4a0e-8bdb-098b33f68a6a tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "GET /compute/v2.1/servers/4e2f7d88-4b19-45a9-8e11-4b0de62052b3" status: 200 len: 1318 microversion: 2.1 time: 0.244731 Feb 03 03:04:48.987175 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 451/934] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:48 2022] GET /compute/v2.1/servers/4e2f7d88-4b19-45a9-8e11-4b0de62052b3 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:49.577611 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-0d04ca2b-9cec-419b-864a-e2195b939222 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:49.578310 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-0d04ca2b-9cec-419b-864a-e2195b939222 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:49.585009 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0d04ca2b-9cec-419b-864a-e2195b939222 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:49.585539 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0d04ca2b-9cec-419b-864a-e2195b939222 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:49.586830 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0d04ca2b-9cec-419b-864a-e2195b939222 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:49.587499 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0d04ca2b-9cec-419b-864a-e2195b939222 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:49.752694 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-0d04ca2b-9cec-419b-864a-e2195b939222 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:49.761173 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-0d04ca2b-9cec-419b-864a-e2195b939222 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1758 microversion: 2.1 time: 0.188185 Feb 03 03:04:49.761750 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 484/935] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:49 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1758 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:49.886381 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-de062f9a-f036-4c93-b117-c15942edebb4 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:49.887018 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-de062f9a-f036-4c93-b117-c15942edebb4 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 4cbae628-c830-4c00-9f73-83e7b4902acd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:49.893693 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-de062f9a-f036-4c93-b117-c15942edebb4 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:49.894192 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-de062f9a-f036-4c93-b117-c15942edebb4 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:49.894971 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-de062f9a-f036-4c93-b117-c15942edebb4 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:49.895391 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-de062f9a-f036-4c93-b117-c15942edebb4 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:49.910280 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.wsgi [None req-de062f9a-f036-4c93-b117-c15942edebb4 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] HTTP exception thrown: Instance 4cbae628-c830-4c00-9f73-83e7b4902acd could not be found. Feb 03 03:04:49.911134 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-de062f9a-f036-4c93-b117-c15942edebb4 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Returning 404 to user: Instance 4cbae628-c830-4c00-9f73-83e7b4902acd could not be found. {{(pid=116385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 03:04:49.911993 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-de062f9a-f036-4c93-b117-c15942edebb4 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd" status: 404 len: 111 microversion: 2.1 time: 0.029594 Feb 03 03:04:49.912545 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 452/936] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:49 2022] GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 03:04:50.003533 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-b5f58eea-131e-47ee-80b6-403140da6ba9 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:50.004139 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-b5f58eea-131e-47ee-80b6-403140da6ba9 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 4e2f7d88-4b19-45a9-8e11-4b0de62052b3] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:50.010715 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-bd48d69e-025c-4df9-854f-ec812164ea23 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1357368738", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1043137288", "security_groups": [{"name": "tempest-secgroup-smoke-1844821108"}], "block_device_mapping_v2": [{"uuid": "b56852c4-375d-43cc-8648-6dd0f5f649b2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1f509aa5-ebd0-421b-bf85-c9ee605b4c0c"}]}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:04:50.011197 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b5f58eea-131e-47ee-80b6-403140da6ba9 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:50.011956 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b5f58eea-131e-47ee-80b6-403140da6ba9 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:50.013320 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b5f58eea-131e-47ee-80b6-403140da6ba9 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:50.013893 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b5f58eea-131e-47ee-80b6-403140da6ba9 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:50.133408 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.network.neutron [None req-bd48d69e-025c-4df9-854f-ec812164ea23 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] validate_networks() for [('1f509aa5-ebd0-421b-bf85-c9ee605b4c0c', None, None, None, None, None)] {{(pid=116385) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 03 03:04:50.250879 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-b5f58eea-131e-47ee-80b6-403140da6ba9 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c8680f685446b2b96aaea84587b7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c17e83a1e6491b9caecd968321a263', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:50.258631 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-b5f58eea-131e-47ee-80b6-403140da6ba9 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "GET /compute/v2.1/servers/4e2f7d88-4b19-45a9-8e11-4b0de62052b3" status: 200 len: 1508 microversion: 2.1 time: 0.259120 Feb 03 03:04:50.259198 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 485/937] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:49 2022] GET /compute/v2.1/servers/4e2f7d88-4b19-45a9-8e11-4b0de62052b3 => generated 1508 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:50.263553 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-6cd4d437-ae05-4910-902d-3c535734396d req-e510d39d-1798-4747-b756-c7c9431a0291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cbae628-c830-4c00-9f73-83e7b4902acd", "name": "network-vif-unplugged", "status": "completed", "tag": "5c0fa8f4-c18a-48b0-aa0e-25cfceb29350"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:04:50.265116 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:04:50.265116 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 03:04:50.272269 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-6cd4d437-ae05-4910-902d-3c535734396d req-e510d39d-1798-4747-b756-c7c9431a0291 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:50.272619 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-6cd4d437-ae05-4910-902d-3c535734396d req-e510d39d-1798-4747-b756-c7c9431a0291 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:50.284683 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-6cd4d437-ae05-4910-902d-3c535734396d req-e510d39d-1798-4747-b756-c7c9431a0291 service nova] Creating event network-vif-unplugged:5c0fa8f4-c18a-48b0-aa0e-25cfceb29350 for instance 4cbae628-c830-4c00-9f73-83e7b4902acd on hv-cinder-82758 Feb 03 03:04:50.289657 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-6cd4d437-ae05-4910-902d-3c535734396d req-e510d39d-1798-4747-b756-c7c9431a0291 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029226 Feb 03 03:04:50.290271 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 486/938] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:04:50.539112 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-bd48d69e-025c-4df9-854f-ec812164ea23 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Flavor limits 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 03 03:04:50.539622 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-bd48d69e-025c-4df9-854f-ec812164ea23 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Image limits 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 03 03:04:50.540075 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-bd48d69e-025c-4df9-854f-ec812164ea23 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Flavor pref 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 03 03:04:50.540467 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-bd48d69e-025c-4df9-854f-ec812164ea23 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Image pref 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 03 03:04:50.540925 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-bd48d69e-025c-4df9-854f-ec812164ea23 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 03 03:04:50.549875 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bd48d69e-025c-4df9-854f-ec812164ea23 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:50.550315 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bd48d69e-025c-4df9-854f-ec812164ea23 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:50.551104 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bd48d69e-025c-4df9-854f-ec812164ea23 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:50.551526 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-bd48d69e-025c-4df9-854f-ec812164ea23 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:50.571673 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-bd48d69e-025c-4df9-854f-ec812164ea23 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Getting quotas for project 264ee2f5b580483c85a302041b05c23f. Resources: {'cores', 'ram', 'instances'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 03:04:50.576933 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-bd48d69e-025c-4df9-854f-ec812164ea23 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Getting quotas for user 6a97115409ba4be989f9071c61df79a5 and project 264ee2f5b580483c85a302041b05c23f. Resources: {'cores', 'ram', 'instances'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 03:04:50.642355 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-bd48d69e-025c-4df9-854f-ec812164ea23 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Going to run 1 instances... {{(pid=116385) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 03 03:04:50.645181 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-bd48d69e-025c-4df9-854f-ec812164ea23 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 6ab6ad78-2698-4a09-a9a5-49fa4e597aa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b56852c4-375d-43cc-8648-6dd0f5f649b2',volume_size=None,volume_type=None)] {{(pid=116385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 03 03:04:50.769385 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-bd48d69e-025c-4df9-854f-ec812164ea23 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.762312 Feb 03 03:04:50.770020 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 453/939] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Feb 3 03:04:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 03 03:04:50.778435 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-bb8bdaa2-5fad-47ba-b6e8-ed2826049079 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:50.779185 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-bb8bdaa2-5fad-47ba-b6e8-ed2826049079 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:50.782416 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-b51f5791-d359-4cc7-87e0-7f2cb1eb4bc2 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:50.783719 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-b51f5791-d359-4cc7-87e0-7f2cb1eb4bc2 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 6ab6ad78-2698-4a09-a9a5-49fa4e597aa3] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:50.785809 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-bb8bdaa2-5fad-47ba-b6e8-ed2826049079 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:50.786321 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-bb8bdaa2-5fad-47ba-b6e8-ed2826049079 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:50.787166 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-bb8bdaa2-5fad-47ba-b6e8-ed2826049079 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:50.787648 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-bb8bdaa2-5fad-47ba-b6e8-ed2826049079 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:50.858218 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-b51f5791-d359-4cc7-87e0-7f2cb1eb4bc2 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:50.865738 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-b51f5791-d359-4cc7-87e0-7f2cb1eb4bc2 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3" status: 200 len: 1095 microversion: 2.1 time: 0.087721 Feb 03 03:04:50.866652 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 454/940] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:50 2022] GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3 => generated 1095 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:50.962409 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-bb8bdaa2-5fad-47ba-b6e8-ed2826049079 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:50.970702 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-bb8bdaa2-5fad-47ba-b6e8-ed2826049079 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1758 microversion: 2.1 time: 0.196961 Feb 03 03:04:50.973134 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 487/941] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:50 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1758 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:51.883418 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-8287c8c3-c865-47dc-826d-ae6cfe07fbda tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:51.887420 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-8287c8c3-c865-47dc-826d-ae6cfe07fbda tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 6ab6ad78-2698-4a09-a9a5-49fa4e597aa3] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:51.899357 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8287c8c3-c865-47dc-826d-ae6cfe07fbda tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:51.899808 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8287c8c3-c865-47dc-826d-ae6cfe07fbda tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:51.900630 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8287c8c3-c865-47dc-826d-ae6cfe07fbda tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:51.901100 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-8287c8c3-c865-47dc-826d-ae6cfe07fbda tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:51.961988 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-8287c8c3-c865-47dc-826d-ae6cfe07fbda tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:51.969990 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-8287c8c3-c865-47dc-826d-ae6cfe07fbda tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3" status: 200 len: 1211 microversion: 2.1 time: 0.090856 Feb 03 03:04:51.970643 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 455/942] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:51 2022] GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3 => generated 1211 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:51.987613 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-92a7910f-091a-43a8-a2f1-2baeafaa1e6a tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:51.988217 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-92a7910f-091a-43a8-a2f1-2baeafaa1e6a tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:51.994930 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-92a7910f-091a-43a8-a2f1-2baeafaa1e6a tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:51.995377 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-92a7910f-091a-43a8-a2f1-2baeafaa1e6a tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:51.996177 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-92a7910f-091a-43a8-a2f1-2baeafaa1e6a tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:51.996624 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-92a7910f-091a-43a8-a2f1-2baeafaa1e6a tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:52.153201 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-92a7910f-091a-43a8-a2f1-2baeafaa1e6a tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:52.162266 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-92a7910f-091a-43a8-a2f1-2baeafaa1e6a tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1758 microversion: 2.1 time: 0.178687 Feb 03 03:04:52.162813 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 488/943] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:51 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:52.988167 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-b09f9c12-b76a-4b81-92fb-7360dc9ea3c9 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:52.988892 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-b09f9c12-b76a-4b81-92fb-7360dc9ea3c9 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 6ab6ad78-2698-4a09-a9a5-49fa4e597aa3] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:52.995615 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b09f9c12-b76a-4b81-92fb-7360dc9ea3c9 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:52.996133 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b09f9c12-b76a-4b81-92fb-7360dc9ea3c9 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:52.997063 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b09f9c12-b76a-4b81-92fb-7360dc9ea3c9 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:52.997591 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-b09f9c12-b76a-4b81-92fb-7360dc9ea3c9 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:53.095833 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-57dfff14-5e4d-497a-bb0c-a4b66a1f137d req-290f32d0-f48c-435b-8347-437a4681a84f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ab6ad78-2698-4a09-a9a5-49fa4e597aa3", "tag": "a9ba86bb-26b3-4ebd-ac40-8804b29ecd9c"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:04:53.098286 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:04:53.098286 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 03:04:53.113734 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-57dfff14-5e4d-497a-bb0c-a4b66a1f137d req-290f32d0-f48c-435b-8347-437a4681a84f service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:53.114185 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-57dfff14-5e4d-497a-bb0c-a4b66a1f137d req-290f32d0-f48c-435b-8347-437a4681a84f service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:53.143407 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-57dfff14-5e4d-497a-bb0c-a4b66a1f137d req-290f32d0-f48c-435b-8347-437a4681a84f service nova] Creating event network-changed:a9ba86bb-26b3-4ebd-ac40-8804b29ecd9c for instance 6ab6ad78-2698-4a09-a9a5-49fa4e597aa3 on hv-cinder-82758 Feb 03 03:04:53.150563 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-57dfff14-5e4d-497a-bb0c-a4b66a1f137d req-290f32d0-f48c-435b-8347-437a4681a84f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058481 Feb 03 03:04:53.151481 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 489/944] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:04:53.180234 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-80697260-75b6-4e5a-adb1-ea5b5329ffac tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:53.180974 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-80697260-75b6-4e5a-adb1-ea5b5329ffac tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:53.189951 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-80697260-75b6-4e5a-adb1-ea5b5329ffac tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:53.190412 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-80697260-75b6-4e5a-adb1-ea5b5329ffac tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:53.191235 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-80697260-75b6-4e5a-adb1-ea5b5329ffac tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:53.191654 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-80697260-75b6-4e5a-adb1-ea5b5329ffac tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:53.193800 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-b09f9c12-b76a-4b81-92fb-7360dc9ea3c9 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:53.202627 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-b09f9c12-b76a-4b81-92fb-7360dc9ea3c9 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3" status: 200 len: 1267 microversion: 2.1 time: 0.218161 Feb 03 03:04:53.204123 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 456/945] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:52 2022] GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3 => generated 1267 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:53.350310 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-80697260-75b6-4e5a-adb1-ea5b5329ffac tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:53.358236 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-80697260-75b6-4e5a-adb1-ea5b5329ffac tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1758 microversion: 2.1 time: 0.182526 Feb 03 03:04:53.358808 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 490/946] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:53 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1758 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 03 03:04:54.220454 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-eeae9840-9f2e-45f7-8126-595002839267 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:54.221099 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-eeae9840-9f2e-45f7-8126-595002839267 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 6ab6ad78-2698-4a09-a9a5-49fa4e597aa3] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:54.227839 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-eeae9840-9f2e-45f7-8126-595002839267 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:54.228279 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-eeae9840-9f2e-45f7-8126-595002839267 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:54.229174 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-eeae9840-9f2e-45f7-8126-595002839267 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:54.229607 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-eeae9840-9f2e-45f7-8126-595002839267 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:54.371358 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-eeae9840-9f2e-45f7-8126-595002839267 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:54.375177 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-45eeb115-9fde-4eb8-bc32-65b0e8d88745 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:54.375850 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-45eeb115-9fde-4eb8-bc32-65b0e8d88745 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:54.379001 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-eeae9840-9f2e-45f7-8126-595002839267 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3" status: 200 len: 1267 microversion: 2.1 time: 0.162643 Feb 03 03:04:54.379569 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 457/947] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:54 2022] GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:54.382537 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-45eeb115-9fde-4eb8-bc32-65b0e8d88745 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:54.383012 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-45eeb115-9fde-4eb8-bc32-65b0e8d88745 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:54.383835 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-45eeb115-9fde-4eb8-bc32-65b0e8d88745 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:54.384274 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-45eeb115-9fde-4eb8-bc32-65b0e8d88745 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:54.548527 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-45eeb115-9fde-4eb8-bc32-65b0e8d88745 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:54.557154 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-45eeb115-9fde-4eb8-bc32-65b0e8d88745 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1758 microversion: 2.1 time: 0.185524 Feb 03 03:04:54.557741 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 491/948] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:54 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1758 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:55.399312 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-93dc480f-4873-4ad3-9fbf-37c815eff23c tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:55.400754 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-93dc480f-4873-4ad3-9fbf-37c815eff23c tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 6ab6ad78-2698-4a09-a9a5-49fa4e597aa3] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:55.407769 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-93dc480f-4873-4ad3-9fbf-37c815eff23c tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:55.408239 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-93dc480f-4873-4ad3-9fbf-37c815eff23c tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:55.409107 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-93dc480f-4873-4ad3-9fbf-37c815eff23c tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:55.409552 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-93dc480f-4873-4ad3-9fbf-37c815eff23c tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:55.551460 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-93dc480f-4873-4ad3-9fbf-37c815eff23c tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:55.558772 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-93dc480f-4873-4ad3-9fbf-37c815eff23c tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3" status: 200 len: 1267 microversion: 2.1 time: 0.165749 Feb 03 03:04:55.559342 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 458/949] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:55 2022] GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:55.573944 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-e4d6ab5f-9dee-4d0a-8c6e-cf6960cfa4fd tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:55.574533 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-e4d6ab5f-9dee-4d0a-8c6e-cf6960cfa4fd tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:55.581009 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e4d6ab5f-9dee-4d0a-8c6e-cf6960cfa4fd tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:55.581461 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e4d6ab5f-9dee-4d0a-8c6e-cf6960cfa4fd tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:55.582248 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e4d6ab5f-9dee-4d0a-8c6e-cf6960cfa4fd tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:55.582678 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e4d6ab5f-9dee-4d0a-8c6e-cf6960cfa4fd tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:55.741325 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-e4d6ab5f-9dee-4d0a-8c6e-cf6960cfa4fd tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:55.750380 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-e4d6ab5f-9dee-4d0a-8c6e-cf6960cfa4fd tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1758 microversion: 2.1 time: 0.180121 Feb 03 03:04:55.750942 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 492/950] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:55 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:56.579628 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-18875732-5d60-440a-b186-9f2331ed1dd8 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:56.580580 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-18875732-5d60-440a-b186-9f2331ed1dd8 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 6ab6ad78-2698-4a09-a9a5-49fa4e597aa3] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:56.591734 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-18875732-5d60-440a-b186-9f2331ed1dd8 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:56.592466 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-18875732-5d60-440a-b186-9f2331ed1dd8 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:56.594213 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-18875732-5d60-440a-b186-9f2331ed1dd8 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:56.594925 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-18875732-5d60-440a-b186-9f2331ed1dd8 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:56.735378 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-18875732-5d60-440a-b186-9f2331ed1dd8 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:56.743398 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-18875732-5d60-440a-b186-9f2331ed1dd8 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3" status: 200 len: 1267 microversion: 2.1 time: 0.169864 Feb 03 03:04:56.743967 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 459/951] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:56 2022] GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:56.767404 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-a7dbf19f-6022-48d5-a72e-20f54ead3f6f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:56.768007 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-a7dbf19f-6022-48d5-a72e-20f54ead3f6f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:56.774801 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a7dbf19f-6022-48d5-a72e-20f54ead3f6f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:56.775251 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a7dbf19f-6022-48d5-a72e-20f54ead3f6f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:56.776034 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a7dbf19f-6022-48d5-a72e-20f54ead3f6f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:56.776469 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a7dbf19f-6022-48d5-a72e-20f54ead3f6f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:56.935100 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-a7dbf19f-6022-48d5-a72e-20f54ead3f6f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:56.943744 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-a7dbf19f-6022-48d5-a72e-20f54ead3f6f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1758 microversion: 2.1 time: 0.180082 Feb 03 03:04:56.944316 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 493/952] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:56 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:57.759702 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-9495416b-dee2-4d43-ba2d-2bbb31067cea tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:57.760257 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-9495416b-dee2-4d43-ba2d-2bbb31067cea tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 6ab6ad78-2698-4a09-a9a5-49fa4e597aa3] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:57.767034 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9495416b-dee2-4d43-ba2d-2bbb31067cea tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:57.767478 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9495416b-dee2-4d43-ba2d-2bbb31067cea tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:57.768266 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9495416b-dee2-4d43-ba2d-2bbb31067cea tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:57.768689 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-9495416b-dee2-4d43-ba2d-2bbb31067cea tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:57.909220 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-9495416b-dee2-4d43-ba2d-2bbb31067cea tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:57.917867 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-9495416b-dee2-4d43-ba2d-2bbb31067cea tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3" status: 200 len: 1267 microversion: 2.1 time: 0.161849 Feb 03 03:04:57.918456 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 460/953] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:57 2022] GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:57.961124 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-a4d1e1db-3c12-4c7d-8f34-84c76344120f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:57.961731 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-a4d1e1db-3c12-4c7d-8f34-84c76344120f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:57.968948 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a4d1e1db-3c12-4c7d-8f34-84c76344120f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:57.969351 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a4d1e1db-3c12-4c7d-8f34-84c76344120f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:57.970128 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a4d1e1db-3c12-4c7d-8f34-84c76344120f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:57.970569 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a4d1e1db-3c12-4c7d-8f34-84c76344120f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:58.126035 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-a4d1e1db-3c12-4c7d-8f34-84c76344120f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:58.134333 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-a4d1e1db-3c12-4c7d-8f34-84c76344120f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1758 microversion: 2.1 time: 0.177023 Feb 03 03:04:58.134926 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 494/954] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:57 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:58.938695 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-3abd206e-8801-4b80-b785-5fb6bfc4b146 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:58.940033 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-3abd206e-8801-4b80-b785-5fb6bfc4b146 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 6ab6ad78-2698-4a09-a9a5-49fa4e597aa3] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:58.949707 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3abd206e-8801-4b80-b785-5fb6bfc4b146 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:58.950152 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3abd206e-8801-4b80-b785-5fb6bfc4b146 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:58.950934 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3abd206e-8801-4b80-b785-5fb6bfc4b146 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:58.951364 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-3abd206e-8801-4b80-b785-5fb6bfc4b146 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:59.098342 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-3abd206e-8801-4b80-b785-5fb6bfc4b146 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:59.106198 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-3abd206e-8801-4b80-b785-5fb6bfc4b146 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3" status: 200 len: 1267 microversion: 2.1 time: 0.173766 Feb 03 03:04:59.107013 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 461/955] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:58 2022] GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:04:59.152091 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-67381f8d-cbb3-4d40-a6f5-4f06f2f2346e tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:04:59.152698 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-67381f8d-cbb3-4d40-a6f5-4f06f2f2346e tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:04:59.160557 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-67381f8d-cbb3-4d40-a6f5-4f06f2f2346e tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:59.161302 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-67381f8d-cbb3-4d40-a6f5-4f06f2f2346e tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:59.163091 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-67381f8d-cbb3-4d40-a6f5-4f06f2f2346e tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:04:59.163537 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-67381f8d-cbb3-4d40-a6f5-4f06f2f2346e tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:04:59.333689 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-67381f8d-cbb3-4d40-a6f5-4f06f2f2346e tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:04:59.342668 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-67381f8d-cbb3-4d40-a6f5-4f06f2f2346e tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1758 microversion: 2.1 time: 0.194648 Feb 03 03:04:59.343629 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 495/956] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:04:59 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1758 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:05:00.123987 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-524999ae-319f-4acf-af64-5da68b97f534 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:05:00.124600 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-524999ae-319f-4acf-af64-5da68b97f534 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 6ab6ad78-2698-4a09-a9a5-49fa4e597aa3] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:05:00.131240 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-524999ae-319f-4acf-af64-5da68b97f534 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:00.131685 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-524999ae-319f-4acf-af64-5da68b97f534 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:00.132476 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-524999ae-319f-4acf-af64-5da68b97f534 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:00.132980 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-524999ae-319f-4acf-af64-5da68b97f534 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:00.273510 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-524999ae-319f-4acf-af64-5da68b97f534 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:05:00.280939 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-524999ae-319f-4acf-af64-5da68b97f534 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3" status: 200 len: 1267 microversion: 2.1 time: 0.161240 Feb 03 03:05:00.281496 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 462/957] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:05:00 2022] GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:05:00.368502 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-5e1bb7d0-43e4-47d3-9827-d5e9aad659fc tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:05:00.369542 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-5e1bb7d0-43e4-47d3-9827-d5e9aad659fc tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:05:00.380208 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5e1bb7d0-43e4-47d3-9827-d5e9aad659fc tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:00.381040 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5e1bb7d0-43e4-47d3-9827-d5e9aad659fc tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:00.382426 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5e1bb7d0-43e4-47d3-9827-d5e9aad659fc tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:00.383139 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5e1bb7d0-43e4-47d3-9827-d5e9aad659fc tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:00.533471 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-5e1bb7d0-43e4-47d3-9827-d5e9aad659fc tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:05:00.541434 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-5e1bb7d0-43e4-47d3-9827-d5e9aad659fc tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1758 microversion: 2.1 time: 0.179050 Feb 03 03:05:00.542005 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 496/958] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:05:00 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:05:01.301061 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-771c17af-7ba8-4ae7-bd3b-9f671c943f28 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:05:01.302027 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-771c17af-7ba8-4ae7-bd3b-9f671c943f28 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 6ab6ad78-2698-4a09-a9a5-49fa4e597aa3] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:05:01.312244 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-771c17af-7ba8-4ae7-bd3b-9f671c943f28 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:01.313049 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-771c17af-7ba8-4ae7-bd3b-9f671c943f28 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:01.314372 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-771c17af-7ba8-4ae7-bd3b-9f671c943f28 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:01.315050 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-771c17af-7ba8-4ae7-bd3b-9f671c943f28 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:01.457722 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-771c17af-7ba8-4ae7-bd3b-9f671c943f28 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:05:01.465825 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-771c17af-7ba8-4ae7-bd3b-9f671c943f28 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3" status: 200 len: 1267 microversion: 2.1 time: 0.171212 Feb 03 03:05:01.466399 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 463/959] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:05:01 2022] GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:05:01.561643 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-b73b679b-fdff-4c7e-8581-111e6b425f2c tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:05:01.562635 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-b73b679b-fdff-4c7e-8581-111e6b425f2c tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:05:01.573454 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b73b679b-fdff-4c7e-8581-111e6b425f2c tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:01.574195 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b73b679b-fdff-4c7e-8581-111e6b425f2c tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:01.575470 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b73b679b-fdff-4c7e-8581-111e6b425f2c tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:01.576190 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b73b679b-fdff-4c7e-8581-111e6b425f2c tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:01.728003 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-b73b679b-fdff-4c7e-8581-111e6b425f2c tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:05:01.736371 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-b73b679b-fdff-4c7e-8581-111e6b425f2c tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1761 microversion: 2.1 time: 0.181163 Feb 03 03:05:01.736994 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 497/960] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:05:01 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1761 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:05:02.199129 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-7ccd2592-4d55-46d3-8eec-c83ab81ed9c4 req-deadec89-1732-4b63-8da6-16a1fdc67c16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ab6ad78-2698-4a09-a9a5-49fa4e597aa3", "name": "network-vif-plugged", "status": "completed", "tag": "a9ba86bb-26b3-4ebd-ac40-8804b29ecd9c"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:05:02.201451 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:05:02.201451 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:05:02.210068 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-7ccd2592-4d55-46d3-8eec-c83ab81ed9c4 req-deadec89-1732-4b63-8da6-16a1fdc67c16 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:02.210543 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-7ccd2592-4d55-46d3-8eec-c83ab81ed9c4 req-deadec89-1732-4b63-8da6-16a1fdc67c16 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:02.223554 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-7ccd2592-4d55-46d3-8eec-c83ab81ed9c4 req-deadec89-1732-4b63-8da6-16a1fdc67c16 service nova] Creating event network-vif-plugged:a9ba86bb-26b3-4ebd-ac40-8804b29ecd9c for instance 6ab6ad78-2698-4a09-a9a5-49fa4e597aa3 on hv-cinder-82758 Feb 03 03:05:02.229372 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-7ccd2592-4d55-46d3-8eec-c83ab81ed9c4 req-deadec89-1732-4b63-8da6-16a1fdc67c16 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034673 Feb 03 03:05:02.230295 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 464/961] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:05:02.482416 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-76ccb65e-2787-4670-b593-55d43eba6dc0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:05:02.483045 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-76ccb65e-2787-4670-b593-55d43eba6dc0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 6ab6ad78-2698-4a09-a9a5-49fa4e597aa3] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:05:02.489300 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-76ccb65e-2787-4670-b593-55d43eba6dc0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:02.489743 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-76ccb65e-2787-4670-b593-55d43eba6dc0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:02.490504 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-76ccb65e-2787-4670-b593-55d43eba6dc0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:02.490940 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-76ccb65e-2787-4670-b593-55d43eba6dc0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:02.628733 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-76ccb65e-2787-4670-b593-55d43eba6dc0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:05:02.636479 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-76ccb65e-2787-4670-b593-55d43eba6dc0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3" status: 200 len: 1267 microversion: 2.1 time: 0.157792 Feb 03 03:05:02.637062 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 498/962] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:05:02 2022] GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:05:03.657177 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-00073baa-a1b7-46d9-8a8f-9644c88b6681 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:05:03.658070 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-00073baa-a1b7-46d9-8a8f-9644c88b6681 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 6ab6ad78-2698-4a09-a9a5-49fa4e597aa3] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:05:03.666907 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-00073baa-a1b7-46d9-8a8f-9644c88b6681 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:03.667496 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-00073baa-a1b7-46d9-8a8f-9644c88b6681 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:03.668536 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-00073baa-a1b7-46d9-8a8f-9644c88b6681 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:03.669145 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-00073baa-a1b7-46d9-8a8f-9644c88b6681 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:03.811525 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-00073baa-a1b7-46d9-8a8f-9644c88b6681 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:05:03.819359 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-00073baa-a1b7-46d9-8a8f-9644c88b6681 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3" status: 200 len: 1267 microversion: 2.1 time: 0.168180 Feb 03 03:05:03.819955 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 465/963] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:05:03 2022] GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:05:04.836289 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-f71c977b-0f67-4e93-a453-7d3119ab17ab tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:05:04.837001 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-f71c977b-0f67-4e93-a453-7d3119ab17ab tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 6ab6ad78-2698-4a09-a9a5-49fa4e597aa3] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:05:04.844918 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f71c977b-0f67-4e93-a453-7d3119ab17ab tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:04.845403 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f71c977b-0f67-4e93-a453-7d3119ab17ab tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:04.846248 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f71c977b-0f67-4e93-a453-7d3119ab17ab tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:04.846722 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f71c977b-0f67-4e93-a453-7d3119ab17ab tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:04.992315 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-f71c977b-0f67-4e93-a453-7d3119ab17ab tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:05:04.999745 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-f71c977b-0f67-4e93-a453-7d3119ab17ab tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3" status: 200 len: 1454 microversion: 2.1 time: 0.167657 Feb 03 03:05:05.000308 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 499/964] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:05:04 2022] GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3 => generated 1454 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:05:05.015722 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-a7fe41db-2355-4bd1-acc6-9334badc0b13 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:05:05.016290 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-a7fe41db-2355-4bd1-acc6-9334badc0b13 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 6ab6ad78-2698-4a09-a9a5-49fa4e597aa3] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:05:05.023896 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a7fe41db-2355-4bd1-acc6-9334badc0b13 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:05.024340 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a7fe41db-2355-4bd1-acc6-9334badc0b13 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:05.025137 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a7fe41db-2355-4bd1-acc6-9334badc0b13 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:05.025560 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a7fe41db-2355-4bd1-acc6-9334badc0b13 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:05.175047 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-a7fe41db-2355-4bd1-acc6-9334badc0b13 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:05:05.182861 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-a7fe41db-2355-4bd1-acc6-9334badc0b13 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3" status: 200 len: 1454 microversion: 2.1 time: 0.170767 Feb 03 03:05:05.183394 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 466/965] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:05:05 2022] GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3 => generated 1454 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:05:05.407542 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-4a812cd1-2e50-4dad-919e-9d1524218a9d tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b772356-db72-40e2-b88b-32c83598d437", "device": "/dev/sdb"}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:05:05.409287 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-4a812cd1-2e50-4dad-919e-9d1524218a9d tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 4e2f7d88-4b19-45a9-8e11-4b0de62052b3] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:05:05.415053 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4a812cd1-2e50-4dad-919e-9d1524218a9d tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:05.415499 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4a812cd1-2e50-4dad-919e-9d1524218a9d tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:05.416267 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4a812cd1-2e50-4dad-919e-9d1524218a9d tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:05.416699 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4a812cd1-2e50-4dad-919e-9d1524218a9d tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:05.658563 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-4a812cd1-2e50-4dad-919e-9d1524218a9d tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "POST /compute/v2.1/servers/4e2f7d88-4b19-45a9-8e11-4b0de62052b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254606 Feb 03 03:05:05.659366 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 500/966] 10.222.0.31 () {60 vars in 1322 bytes} [Thu Feb 3 03:05:05 2022] POST /compute/v2.1/servers/4e2f7d88-4b19-45a9-8e11-4b0de62052b3/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:05:07.081175 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-7995253a-3162-4c96-94b5-7459403a3250 req-d640d62b-a2c6-4bb6-b774-9ec08aa5433e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ab6ad78-2698-4a09-a9a5-49fa4e597aa3", "tag": "a9ba86bb-26b3-4ebd-ac40-8804b29ecd9c"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:05:07.081789 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:05:07.081789 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:05:07.089304 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-7995253a-3162-4c96-94b5-7459403a3250 req-d640d62b-a2c6-4bb6-b774-9ec08aa5433e service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:07.089736 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-7995253a-3162-4c96-94b5-7459403a3250 req-d640d62b-a2c6-4bb6-b774-9ec08aa5433e service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:07.101396 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-7995253a-3162-4c96-94b5-7459403a3250 req-d640d62b-a2c6-4bb6-b774-9ec08aa5433e service nova] Creating event network-changed:a9ba86bb-26b3-4ebd-ac40-8804b29ecd9c for instance 6ab6ad78-2698-4a09-a9a5-49fa4e597aa3 on hv-cinder-82758 Feb 03 03:05:07.106276 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-7995253a-3162-4c96-94b5-7459403a3250 req-d640d62b-a2c6-4bb6-b774-9ec08aa5433e service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029893 Feb 03 03:05:07.106941 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 467/967] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:05:29.456982 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-37c15347-422e-4548-8eb0-1766674064d2 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:05:29.457540 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-37c15347-422e-4548-8eb0-1766674064d2 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 4e2f7d88-4b19-45a9-8e11-4b0de62052b3] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:05:29.464171 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-37c15347-422e-4548-8eb0-1766674064d2 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:29.464618 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-37c15347-422e-4548-8eb0-1766674064d2 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:29.465441 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-37c15347-422e-4548-8eb0-1766674064d2 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:29.465878 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-37c15347-422e-4548-8eb0-1766674064d2 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:29.561111 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.objects.instance [None req-37c15347-422e-4548-8eb0-1766674064d2 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lazy-loading 'services' on Instance uuid 4e2f7d88-4b19-45a9-8e11-4b0de62052b3 {{(pid=116386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 03 03:05:29.639228 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-37c15347-422e-4548-8eb0-1766674064d2 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4e2f7d88-4b19-45a9-8e11-4b0de62052b3/os-volume_attachments/3b772356-db72-40e2-b88b-32c83598d437" status: 202 len: 0 microversion: 2.1 time: 0.186764 Feb 03 03:05:29.639920 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 501/968] 10.222.0.31 () {58 vars in 1415 bytes} [Thu Feb 3 03:05:29 2022] DELETE /compute/v2.1/servers/4e2f7d88-4b19-45a9-8e11-4b0de62052b3/os-volume_attachments/3b772356-db72-40e2-b88b-32c83598d437 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 03 03:05:30.761042 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-f9614481-15ed-4b49-a757-55c8a2b078e4 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:05:30.761575 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-f9614481-15ed-4b49-a757-55c8a2b078e4 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 4e2f7d88-4b19-45a9-8e11-4b0de62052b3] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:05:30.771117 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f9614481-15ed-4b49-a757-55c8a2b078e4 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:30.771713 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f9614481-15ed-4b49-a757-55c8a2b078e4 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:30.772873 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f9614481-15ed-4b49-a757-55c8a2b078e4 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:30.773439 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f9614481-15ed-4b49-a757-55c8a2b078e4 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:30.799598 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-f9614481-15ed-4b49-a757-55c8a2b078e4 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 4e2f7d88-4b19-45a9-8e11-4b0de62052b3] Going to try to terminate instance {{(pid=116385) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 03 03:05:30.877007 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-f9614481-15ed-4b49-a757-55c8a2b078e4 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4e2f7d88-4b19-45a9-8e11-4b0de62052b3" status: 204 len: 0 microversion: 2.1 time: 0.123003 Feb 03 03:05:30.877634 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 468/969] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Feb 3 03:05:30 2022] DELETE /compute/v2.1/servers/4e2f7d88-4b19-45a9-8e11-4b0de62052b3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 03 03:05:30.887826 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-0ba92e99-cd6b-4011-810e-e703f8870754 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:05:30.888689 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-0ba92e99-cd6b-4011-810e-e703f8870754 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 4e2f7d88-4b19-45a9-8e11-4b0de62052b3] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:05:30.896444 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0ba92e99-cd6b-4011-810e-e703f8870754 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:30.896914 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0ba92e99-cd6b-4011-810e-e703f8870754 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:30.897686 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0ba92e99-cd6b-4011-810e-e703f8870754 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:30.898113 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-0ba92e99-cd6b-4011-810e-e703f8870754 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:31.042014 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-0ba92e99-cd6b-4011-810e-e703f8870754 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c8680f685446b2b96aaea84587b7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c17e83a1e6491b9caecd968321a263', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:05:31.050354 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-0ba92e99-cd6b-4011-810e-e703f8870754 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "GET /compute/v2.1/servers/4e2f7d88-4b19-45a9-8e11-4b0de62052b3" status: 200 len: 1514 microversion: 2.1 time: 0.167968 Feb 03 03:05:31.050918 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 502/970] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:05:30 2022] GET /compute/v2.1/servers/4e2f7d88-4b19-45a9-8e11-4b0de62052b3 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:05:32.072319 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-fce7d95e-717a-426e-8bd4-31106b450b24 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:05:32.073307 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-fce7d95e-717a-426e-8bd4-31106b450b24 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 4e2f7d88-4b19-45a9-8e11-4b0de62052b3] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:05:32.083926 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fce7d95e-717a-426e-8bd4-31106b450b24 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:32.084677 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fce7d95e-717a-426e-8bd4-31106b450b24 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:32.086205 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fce7d95e-717a-426e-8bd4-31106b450b24 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:32.086911 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-fce7d95e-717a-426e-8bd4-31106b450b24 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:32.228706 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-fce7d95e-717a-426e-8bd4-31106b450b24 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c8680f685446b2b96aaea84587b7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c17e83a1e6491b9caecd968321a263', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:05:32.236972 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-fce7d95e-717a-426e-8bd4-31106b450b24 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "GET /compute/v2.1/servers/4e2f7d88-4b19-45a9-8e11-4b0de62052b3" status: 200 len: 1514 microversion: 2.1 time: 0.171212 Feb 03 03:05:32.237969 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 469/971] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:05:32 2022] GET /compute/v2.1/servers/4e2f7d88-4b19-45a9-8e11-4b0de62052b3 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:05:33.159084 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-196191b9-0ad6-4901-be12-e37e975a2bb5 req-66d33111-aca3-49a4-af51-d2b7f42cc219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e2f7d88-4b19-45a9-8e11-4b0de62052b3", "name": "network-vif-deleted", "tag": "7d86aab8-5c1f-4e24-814a-145bc924da52"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:05:33.160638 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:05:33.160638 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 03:05:33.168211 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-196191b9-0ad6-4901-be12-e37e975a2bb5 req-66d33111-aca3-49a4-af51-d2b7f42cc219 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:33.168674 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-196191b9-0ad6-4901-be12-e37e975a2bb5 req-66d33111-aca3-49a4-af51-d2b7f42cc219 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:33.179889 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-196191b9-0ad6-4901-be12-e37e975a2bb5 req-66d33111-aca3-49a4-af51-d2b7f42cc219 service nova] Creating event network-vif-deleted:7d86aab8-5c1f-4e24-814a-145bc924da52 for instance 4e2f7d88-4b19-45a9-8e11-4b0de62052b3 on hv-cinder-82758 Feb 03 03:05:33.185069 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-196191b9-0ad6-4901-be12-e37e975a2bb5 req-66d33111-aca3-49a4-af51-d2b7f42cc219 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029603 Feb 03 03:05:33.185838 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 503/972] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:05:33.257790 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-aec7b635-9b93-4d40-985b-d5470f5de852 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:05:33.258397 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-aec7b635-9b93-4d40-985b-d5470f5de852 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 4e2f7d88-4b19-45a9-8e11-4b0de62052b3] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:05:33.264824 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-aec7b635-9b93-4d40-985b-d5470f5de852 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:33.265264 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-aec7b635-9b93-4d40-985b-d5470f5de852 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:33.266044 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-aec7b635-9b93-4d40-985b-d5470f5de852 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:33.266474 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-aec7b635-9b93-4d40-985b-d5470f5de852 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:33.299580 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-aec7b635-9b93-4d40-985b-d5470f5de852 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:33.300014 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-aec7b635-9b93-4d40-985b-d5470f5de852 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:33.300466 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.objects.instance [None req-aec7b635-9b93-4d40-985b-d5470f5de852 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lazy-loading 'fault' on Instance uuid 4e2f7d88-4b19-45a9-8e11-4b0de62052b3 {{(pid=116385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 03 03:05:33.339514 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-aec7b635-9b93-4d40-985b-d5470f5de852 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c8680f685446b2b96aaea84587b7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c17e83a1e6491b9caecd968321a263', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:05:33.347609 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-aec7b635-9b93-4d40-985b-d5470f5de852 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "GET /compute/v2.1/servers/4e2f7d88-4b19-45a9-8e11-4b0de62052b3" status: 200 len: 1308 microversion: 2.1 time: 0.095263 Feb 03 03:05:33.348179 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 470/973] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:05:33 2022] GET /compute/v2.1/servers/4e2f7d88-4b19-45a9-8e11-4b0de62052b3 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:05:34.370552 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-8682e4e5-6621-48d1-a540-f3d6d2164cb2 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:05:34.371666 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-8682e4e5-6621-48d1-a540-f3d6d2164cb2 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 4e2f7d88-4b19-45a9-8e11-4b0de62052b3] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:05:34.378657 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8682e4e5-6621-48d1-a540-f3d6d2164cb2 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:34.379128 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8682e4e5-6621-48d1-a540-f3d6d2164cb2 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:34.379943 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8682e4e5-6621-48d1-a540-f3d6d2164cb2 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:34.380400 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-8682e4e5-6621-48d1-a540-f3d6d2164cb2 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:34.394551 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.wsgi [None req-8682e4e5-6621-48d1-a540-f3d6d2164cb2 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] HTTP exception thrown: Instance 4e2f7d88-4b19-45a9-8e11-4b0de62052b3 could not be found. Feb 03 03:05:34.395150 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-8682e4e5-6621-48d1-a540-f3d6d2164cb2 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Returning 404 to user: Instance 4e2f7d88-4b19-45a9-8e11-4b0de62052b3 could not be found. {{(pid=116386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 03:05:34.395993 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-8682e4e5-6621-48d1-a540-f3d6d2164cb2 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "GET /compute/v2.1/servers/4e2f7d88-4b19-45a9-8e11-4b0de62052b3" status: 404 len: 111 microversion: 2.1 time: 0.033128 Feb 03 03:05:34.396545 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 504/974] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:05:34 2022] GET /compute/v2.1/servers/4e2f7d88-4b19-45a9-8e11-4b0de62052b3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 03:05:42.207534 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-e1784836-366f-4d0c-9b72-43fcfe3c46dd tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2119386589", "imageRef": "99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce", "flavorRef": "452", "networks": [{"uuid": "ee964cae-ff6f-484e-a320-b30e15c79aec"}]}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:05:42.259852 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.network.neutron [None req-e1784836-366f-4d0c-9b72-43fcfe3c46dd tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] validate_networks() for [('ee964cae-ff6f-484e-a320-b30e15c79aec', None, None, None, None, None)] {{(pid=116385) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 03 03:05:42.610325 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-e1784836-366f-4d0c-9b72-43fcfe3c46dd tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Flavor limits 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 03 03:05:42.610739 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-e1784836-366f-4d0c-9b72-43fcfe3c46dd tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Image limits 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 03 03:05:42.611290 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-e1784836-366f-4d0c-9b72-43fcfe3c46dd tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Flavor pref 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 03 03:05:42.611687 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-e1784836-366f-4d0c-9b72-43fcfe3c46dd tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Image pref 0:0:0 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 03 03:05:42.612085 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.virt.hardware [None req-e1784836-366f-4d0c-9b72-43fcfe3c46dd tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116385) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 03 03:05:42.623084 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e1784836-366f-4d0c-9b72-43fcfe3c46dd tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:42.623708 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e1784836-366f-4d0c-9b72-43fcfe3c46dd tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:42.624650 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e1784836-366f-4d0c-9b72-43fcfe3c46dd tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:42.625155 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e1784836-366f-4d0c-9b72-43fcfe3c46dd tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:42.646294 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-e1784836-366f-4d0c-9b72-43fcfe3c46dd tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Getting quotas for project b3c17e83a1e6491b9caecd968321a263. Resources: {'cores', 'ram', 'instances'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 03:05:42.650294 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.quota [None req-e1784836-366f-4d0c-9b72-43fcfe3c46dd tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Getting quotas for user 04c8680f685446b2b96aaea84587b7bd and project b3c17e83a1e6491b9caecd968321a263. Resources: {'cores', 'ram', 'instances'} {{(pid=116385) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 03:05:42.660820 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-e1784836-366f-4d0c-9b72-43fcfe3c46dd tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Going to run 1 instances... {{(pid=116385) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 03 03:05:42.663099 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-e1784836-366f-4d0c-9b72-43fcfe3c46dd tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 5a4dc0b3-873e-4eff-9856-ed40da69a404] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='99f55a0d-eb47-4fb8-930e-eefa2d0dd1ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116385) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 03 03:05:42.711167 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-e1784836-366f-4d0c-9b72-43fcfe3c46dd tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.507306 Feb 03 03:05:42.711849 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 471/975] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Feb 3 03:05:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 03 03:05:42.721850 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-ed37c7c7-8781-44d4-86af-3ef8070520d4 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:05:42.722433 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-ed37c7c7-8781-44d4-86af-3ef8070520d4 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 5a4dc0b3-873e-4eff-9856-ed40da69a404] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:05:42.775129 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-ed37c7c7-8781-44d4-86af-3ef8070520d4 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c8680f685446b2b96aaea84587b7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c17e83a1e6491b9caecd968321a263', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:05:42.781877 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-ed37c7c7-8781-44d4-86af-3ef8070520d4 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "GET /compute/v2.1/servers/5a4dc0b3-873e-4eff-9856-ed40da69a404" status: 200 len: 1219 microversion: 2.1 time: 0.063704 Feb 03 03:05:42.782422 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 505/976] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:05:42 2022] GET /compute/v2.1/servers/5a4dc0b3-873e-4eff-9856-ed40da69a404 => generated 1219 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:05:43.799430 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-96f93d9f-230f-4754-b9bd-9e4d0c74b436 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:05:43.800150 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-96f93d9f-230f-4754-b9bd-9e4d0c74b436 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 5a4dc0b3-873e-4eff-9856-ed40da69a404] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:05:43.807104 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-96f93d9f-230f-4754-b9bd-9e4d0c74b436 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:43.807673 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-96f93d9f-230f-4754-b9bd-9e4d0c74b436 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:43.808516 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-96f93d9f-230f-4754-b9bd-9e4d0c74b436 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:43.809033 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-96f93d9f-230f-4754-b9bd-9e4d0c74b436 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:43.871797 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-96f93d9f-230f-4754-b9bd-9e4d0c74b436 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c8680f685446b2b96aaea84587b7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c17e83a1e6491b9caecd968321a263', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:05:43.879275 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-96f93d9f-230f-4754-b9bd-9e4d0c74b436 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "GET /compute/v2.1/servers/5a4dc0b3-873e-4eff-9856-ed40da69a404" status: 200 len: 1277 microversion: 2.1 time: 0.084269 Feb 03 03:05:43.879832 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 472/977] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:05:43 2022] GET /compute/v2.1/servers/5a4dc0b3-873e-4eff-9856-ed40da69a404 => generated 1277 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:05:44.895784 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-5b9799f9-bc69-4354-9926-eb1d559d28b0 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:05:44.896388 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-5b9799f9-bc69-4354-9926-eb1d559d28b0 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 5a4dc0b3-873e-4eff-9856-ed40da69a404] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:05:44.903484 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5b9799f9-bc69-4354-9926-eb1d559d28b0 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:44.903919 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5b9799f9-bc69-4354-9926-eb1d559d28b0 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:44.904741 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5b9799f9-bc69-4354-9926-eb1d559d28b0 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:44.905181 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-5b9799f9-bc69-4354-9926-eb1d559d28b0 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:44.941127 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-74a67c31-d7ac-462d-8299-6a04b99a9881 req-75a8aebe-7cdc-43fd-a814-9c8bee7d83ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a4dc0b3-873e-4eff-9856-ed40da69a404", "tag": "c4be19ca-7543-4609-b13c-a0b0a73f0618"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:05:44.942693 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:05:44.942693 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:05:44.951577 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-74a67c31-d7ac-462d-8299-6a04b99a9881 req-75a8aebe-7cdc-43fd-a814-9c8bee7d83ad service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:44.953230 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-74a67c31-d7ac-462d-8299-6a04b99a9881 req-75a8aebe-7cdc-43fd-a814-9c8bee7d83ad service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:44.977159 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-74a67c31-d7ac-462d-8299-6a04b99a9881 req-75a8aebe-7cdc-43fd-a814-9c8bee7d83ad service nova] Creating event network-changed:c4be19ca-7543-4609-b13c-a0b0a73f0618 for instance 5a4dc0b3-873e-4eff-9856-ed40da69a404 on hv-cinder-82758 Feb 03 03:05:44.984004 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-74a67c31-d7ac-462d-8299-6a04b99a9881 req-75a8aebe-7cdc-43fd-a814-9c8bee7d83ad service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046167 Feb 03 03:05:44.984695 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 473/978] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 03 03:05:45.054557 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-5b9799f9-bc69-4354-9926-eb1d559d28b0 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c8680f685446b2b96aaea84587b7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c17e83a1e6491b9caecd968321a263', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:05:45.062002 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-5b9799f9-bc69-4354-9926-eb1d559d28b0 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "GET /compute/v2.1/servers/5a4dc0b3-873e-4eff-9856-ed40da69a404" status: 200 len: 1319 microversion: 2.1 time: 0.170056 Feb 03 03:05:45.062564 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 506/979] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:05:44 2022] GET /compute/v2.1/servers/5a4dc0b3-873e-4eff-9856-ed40da69a404 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:05:46.084061 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-84ff2a51-8dff-4489-8e1c-27416bb0b451 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:05:46.085161 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-84ff2a51-8dff-4489-8e1c-27416bb0b451 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 5a4dc0b3-873e-4eff-9856-ed40da69a404] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:05:46.094877 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-84ff2a51-8dff-4489-8e1c-27416bb0b451 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:46.095321 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-84ff2a51-8dff-4489-8e1c-27416bb0b451 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:46.096086 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-84ff2a51-8dff-4489-8e1c-27416bb0b451 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:46.096509 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-84ff2a51-8dff-4489-8e1c-27416bb0b451 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:46.245344 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-84ff2a51-8dff-4489-8e1c-27416bb0b451 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c8680f685446b2b96aaea84587b7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c17e83a1e6491b9caecd968321a263', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:05:46.253351 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-84ff2a51-8dff-4489-8e1c-27416bb0b451 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "GET /compute/v2.1/servers/5a4dc0b3-873e-4eff-9856-ed40da69a404" status: 200 len: 1319 microversion: 2.1 time: 0.176577 Feb 03 03:05:46.262385 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 474/980] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:05:46 2022] GET /compute/v2.1/servers/5a4dc0b3-873e-4eff-9856-ed40da69a404 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:05:47.274019 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-cb082eff-1155-4da9-84a4-fd446a23dc8b tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:05:47.275011 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-cb082eff-1155-4da9-84a4-fd446a23dc8b tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 5a4dc0b3-873e-4eff-9856-ed40da69a404] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:05:47.285765 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cb082eff-1155-4da9-84a4-fd446a23dc8b tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:47.286492 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cb082eff-1155-4da9-84a4-fd446a23dc8b tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:47.287818 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cb082eff-1155-4da9-84a4-fd446a23dc8b tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:47.288531 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-cb082eff-1155-4da9-84a4-fd446a23dc8b tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:47.436157 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-cb082eff-1155-4da9-84a4-fd446a23dc8b tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c8680f685446b2b96aaea84587b7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c17e83a1e6491b9caecd968321a263', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:05:47.445444 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-cb082eff-1155-4da9-84a4-fd446a23dc8b tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "GET /compute/v2.1/servers/5a4dc0b3-873e-4eff-9856-ed40da69a404" status: 200 len: 1319 microversion: 2.1 time: 0.177704 Feb 03 03:05:47.446271 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 507/981] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:05:47 2022] GET /compute/v2.1/servers/5a4dc0b3-873e-4eff-9856-ed40da69a404 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:05:48.430654 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-f4a1f7c1-45e1-4743-9f15-e13e2765998c req-e98df652-42d9-4314-a429-3b6a1ee7fe56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a4dc0b3-873e-4eff-9856-ed40da69a404", "name": "network-vif-plugged", "status": "completed", "tag": "c4be19ca-7543-4609-b13c-a0b0a73f0618"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:05:48.432239 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:05:48.432239 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:05:48.442626 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-f4a1f7c1-45e1-4743-9f15-e13e2765998c req-e98df652-42d9-4314-a429-3b6a1ee7fe56 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:48.443219 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-f4a1f7c1-45e1-4743-9f15-e13e2765998c req-e98df652-42d9-4314-a429-3b6a1ee7fe56 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:48.457137 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-f4a1f7c1-45e1-4743-9f15-e13e2765998c req-e98df652-42d9-4314-a429-3b6a1ee7fe56 service nova] Creating event network-vif-plugged:c4be19ca-7543-4609-b13c-a0b0a73f0618 for instance 5a4dc0b3-873e-4eff-9856-ed40da69a404 on hv-cinder-82758 Feb 03 03:05:48.462050 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-f4a1f7c1-45e1-4743-9f15-e13e2765998c req-e98df652-42d9-4314-a429-3b6a1ee7fe56 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035268 Feb 03 03:05:48.462392 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-6172b78d-ab63-4b49-8195-21b36f2d82c3 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:05:48.462884 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 475/982] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:05:48.463778 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-6172b78d-ab63-4b49-8195-21b36f2d82c3 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 5a4dc0b3-873e-4eff-9856-ed40da69a404] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:05:48.470822 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6172b78d-ab63-4b49-8195-21b36f2d82c3 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:48.471266 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6172b78d-ab63-4b49-8195-21b36f2d82c3 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:48.472288 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6172b78d-ab63-4b49-8195-21b36f2d82c3 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:48.472751 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-6172b78d-ab63-4b49-8195-21b36f2d82c3 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:48.609253 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-6172b78d-ab63-4b49-8195-21b36f2d82c3 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c8680f685446b2b96aaea84587b7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c17e83a1e6491b9caecd968321a263', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:05:48.616701 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-6172b78d-ab63-4b49-8195-21b36f2d82c3 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "GET /compute/v2.1/servers/5a4dc0b3-873e-4eff-9856-ed40da69a404" status: 200 len: 1319 microversion: 2.1 time: 0.158391 Feb 03 03:05:48.617294 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 508/983] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:05:48 2022] GET /compute/v2.1/servers/5a4dc0b3-873e-4eff-9856-ed40da69a404 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:05:49.633578 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-7fa9a448-2e38-46bc-9dbf-c6c44898d231 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:05:49.634270 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-7fa9a448-2e38-46bc-9dbf-c6c44898d231 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 5a4dc0b3-873e-4eff-9856-ed40da69a404] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:05:49.640502 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7fa9a448-2e38-46bc-9dbf-c6c44898d231 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:49.640971 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7fa9a448-2e38-46bc-9dbf-c6c44898d231 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:49.641745 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7fa9a448-2e38-46bc-9dbf-c6c44898d231 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:49.642209 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-7fa9a448-2e38-46bc-9dbf-c6c44898d231 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:49.778460 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-7fa9a448-2e38-46bc-9dbf-c6c44898d231 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c8680f685446b2b96aaea84587b7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c17e83a1e6491b9caecd968321a263', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:05:49.785951 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-7fa9a448-2e38-46bc-9dbf-c6c44898d231 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "GET /compute/v2.1/servers/5a4dc0b3-873e-4eff-9856-ed40da69a404" status: 200 len: 1319 microversion: 2.1 time: 0.156456 Feb 03 03:05:49.786554 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 476/984] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:05:49 2022] GET /compute/v2.1/servers/5a4dc0b3-873e-4eff-9856-ed40da69a404 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:05:50.806883 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-f56f45f4-8514-4d0a-9345-9459e8aca28a tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:05:50.807841 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-f56f45f4-8514-4d0a-9345-9459e8aca28a tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 5a4dc0b3-873e-4eff-9856-ed40da69a404] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:05:50.818542 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f56f45f4-8514-4d0a-9345-9459e8aca28a tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:50.819280 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f56f45f4-8514-4d0a-9345-9459e8aca28a tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:50.820662 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f56f45f4-8514-4d0a-9345-9459e8aca28a tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:50.821322 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f56f45f4-8514-4d0a-9345-9459e8aca28a tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:50.963049 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-f56f45f4-8514-4d0a-9345-9459e8aca28a tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c8680f685446b2b96aaea84587b7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c17e83a1e6491b9caecd968321a263', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:05:50.978192 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-f56f45f4-8514-4d0a-9345-9459e8aca28a tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "GET /compute/v2.1/servers/5a4dc0b3-873e-4eff-9856-ed40da69a404" status: 200 len: 1508 microversion: 2.1 time: 0.177195 Feb 03 03:05:50.978960 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 509/985] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:05:50 2022] GET /compute/v2.1/servers/5a4dc0b3-873e-4eff-9856-ed40da69a404 => generated 1508 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:05:51.000163 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-f9a4d845-61b6-496a-9130-90c5986bce5f tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18f8ce56-f5a2-4f97-88b6-a6017ff29257", "device": "/dev/sdb"}} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:05:51.002079 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-f9a4d845-61b6-496a-9130-90c5986bce5f tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 5a4dc0b3-873e-4eff-9856-ed40da69a404] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:05:51.008754 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f9a4d845-61b6-496a-9130-90c5986bce5f tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:51.009230 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f9a4d845-61b6-496a-9130-90c5986bce5f tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:51.009998 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f9a4d845-61b6-496a-9130-90c5986bce5f tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:05:51.010426 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f9a4d845-61b6-496a-9130-90c5986bce5f tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:05:51.254619 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-f9a4d845-61b6-496a-9130-90c5986bce5f tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "POST /compute/v2.1/servers/5a4dc0b3-873e-4eff-9856-ed40da69a404/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260137 Feb 03 03:05:51.255234 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 477/986] 10.222.0.31 () {60 vars in 1322 bytes} [Thu Feb 3 03:05:50 2022] POST /compute/v2.1/servers/5a4dc0b3-873e-4eff-9856-ed40da69a404/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:06:05.293160 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-4f5f3206-f8f8-4aef-a5cc-cebbc08a314d tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1271164535"}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:06:05.293698 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-4f5f3206-f8f8-4aef-a5cc-cebbc08a314d tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:06:05.300019 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4f5f3206-f8f8-4aef-a5cc-cebbc08a314d tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:05.300475 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4f5f3206-f8f8-4aef-a5cc-cebbc08a314d tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:05.301280 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4f5f3206-f8f8-4aef-a5cc-cebbc08a314d tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:05.301718 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-4f5f3206-f8f8-4aef-a5cc-cebbc08a314d tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:05.430753 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.network.security_group_api [None req-4f5f3206-f8f8-4aef-a5cc-cebbc08a314d tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Removing security group 19a5db45-ca6d-4c4f-adb1-c2141ce4b05a from port 9ec67dbd-d798-42d9-982f-ae69f4d47df6 Feb 03 03:06:05.764420 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-4f5f3206-f8f8-4aef-a5cc-cebbc08a314d tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "POST /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414/action" status: 202 len: 0 microversion: 2.1 time: 0.475285 Feb 03 03:06:05.765255 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 510/987] 10.222.0.31 () {60 vars in 1277 bytes} [Thu Feb 3 03:06:05 2022] POST /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 03 03:06:05.782162 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-e967e93d-736b-4dee-8e1c-2e53c7c57d5f req-cc6610f4-2b22-45e6-a315-cf769b77e009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74a55f26-9a9c-453f-89e5-b19794d5b414", "tag": "9ec67dbd-d798-42d9-982f-ae69f4d47df6"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:06:05.784919 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:06:05.784919 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:06:05.804529 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-e967e93d-736b-4dee-8e1c-2e53c7c57d5f req-cc6610f4-2b22-45e6-a315-cf769b77e009 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:05.807870 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-e967e93d-736b-4dee-8e1c-2e53c7c57d5f req-cc6610f4-2b22-45e6-a315-cf769b77e009 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:05.829272 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-e967e93d-736b-4dee-8e1c-2e53c7c57d5f req-cc6610f4-2b22-45e6-a315-cf769b77e009 service nova] Creating event network-changed:9ec67dbd-d798-42d9-982f-ae69f4d47df6 for instance 74a55f26-9a9c-453f-89e5-b19794d5b414 on hv-cinder-82758 Feb 03 03:06:05.843559 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-e967e93d-736b-4dee-8e1c-2e53c7c57d5f req-cc6610f4-2b22-45e6-a315-cf769b77e009 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065476 Feb 03 03:06:05.845333 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 478/988] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:06:07.190185 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-c275b8da-e3b8-40b7-b440-9f7702519c92 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:06:07.190185 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-c275b8da-e3b8-40b7-b440-9f7702519c92 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:06:07.196415 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c275b8da-e3b8-40b7-b440-9f7702519c92 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:07.196883 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c275b8da-e3b8-40b7-b440-9f7702519c92 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:07.197651 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c275b8da-e3b8-40b7-b440-9f7702519c92 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:07.198063 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c275b8da-e3b8-40b7-b440-9f7702519c92 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:07.277224 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.objects.instance [None req-c275b8da-e3b8-40b7-b440-9f7702519c92 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lazy-loading 'services' on Instance uuid 74a55f26-9a9c-453f-89e5-b19794d5b414 {{(pid=116386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 03 03:06:07.348178 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-c275b8da-e3b8-40b7-b440-9f7702519c92 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "DELETE /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414/os-volume_attachments/77b0333f-f8a1-41df-85d0-712c6fc72db3" status: 202 len: 0 microversion: 2.1 time: 0.163423 Feb 03 03:06:07.348884 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 511/989] 10.222.0.31 () {58 vars in 1415 bytes} [Thu Feb 3 03:06:07 2022] DELETE /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414/os-volume_attachments/77b0333f-f8a1-41df-85d0-712c6fc72db3 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 03 03:06:07.357657 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-ac3c210e-2803-407d-8890-15c8e7d7aace tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:06:07.359331 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-ac3c210e-2803-407d-8890-15c8e7d7aace tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:06:07.366544 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ac3c210e-2803-407d-8890-15c8e7d7aace tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:07.367048 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ac3c210e-2803-407d-8890-15c8e7d7aace tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:07.368119 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ac3c210e-2803-407d-8890-15c8e7d7aace tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:07.368647 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-ac3c210e-2803-407d-8890-15c8e7d7aace tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:07.398821 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-ac3c210e-2803-407d-8890-15c8e7d7aace tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045065 Feb 03 03:06:07.399411 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 479/990] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Feb 3 03:06:07 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 03 03:06:07.860832 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-82addd5a-2546-4e76-9620-aba05f0b74fc req-efcda315-dc4e-4799-88cd-6fe7571ed7c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74a55f26-9a9c-453f-89e5-b19794d5b414", "tag": "9ec67dbd-d798-42d9-982f-ae69f4d47df6"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:06:07.862349 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:06:07.862349 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 03:06:07.869541 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-82addd5a-2546-4e76-9620-aba05f0b74fc req-efcda315-dc4e-4799-88cd-6fe7571ed7c9 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:07.869960 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-82addd5a-2546-4e76-9620-aba05f0b74fc req-efcda315-dc4e-4799-88cd-6fe7571ed7c9 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:07.881718 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-82addd5a-2546-4e76-9620-aba05f0b74fc req-efcda315-dc4e-4799-88cd-6fe7571ed7c9 service nova] Creating event network-changed:9ec67dbd-d798-42d9-982f-ae69f4d47df6 for instance 74a55f26-9a9c-453f-89e5-b19794d5b414 on hv-cinder-82758 Feb 03 03:06:07.886706 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-82addd5a-2546-4e76-9620-aba05f0b74fc req-efcda315-dc4e-4799-88cd-6fe7571ed7c9 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029749 Feb 03 03:06:07.887292 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 512/991] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 03 03:06:08.411316 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-d96326fc-50d1-4672-910f-6c306ad777ad tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:06:08.412125 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-d96326fc-50d1-4672-910f-6c306ad777ad tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:06:08.419162 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d96326fc-50d1-4672-910f-6c306ad777ad tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:08.419604 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d96326fc-50d1-4672-910f-6c306ad777ad tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:08.420394 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d96326fc-50d1-4672-910f-6c306ad777ad tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:08.420854 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d96326fc-50d1-4672-910f-6c306ad777ad tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:08.450676 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-d96326fc-50d1-4672-910f-6c306ad777ad tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043271 Feb 03 03:06:08.451447 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 480/992] 10.222.0.31 () {58 vars in 1301 bytes} [Thu Feb 3 03:06:08 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 03 03:06:08.462157 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-f96ec233-5bc3-4648-bcca-15b709b4141c tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:06:08.462733 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-f96ec233-5bc3-4648-bcca-15b709b4141c tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:06:08.469464 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f96ec233-5bc3-4648-bcca-15b709b4141c tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:08.469901 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f96ec233-5bc3-4648-bcca-15b709b4141c tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:08.470881 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f96ec233-5bc3-4648-bcca-15b709b4141c tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:08.471305 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f96ec233-5bc3-4648-bcca-15b709b4141c tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:08.528744 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-e7912a18-159a-41f3-8b16-aa26dcce031b tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:06:08.529229 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-e7912a18-159a-41f3-8b16-aa26dcce031b tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 5a4dc0b3-873e-4eff-9856-ed40da69a404] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:06:08.535063 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e7912a18-159a-41f3-8b16-aa26dcce031b tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:08.535508 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e7912a18-159a-41f3-8b16-aa26dcce031b tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:08.536402 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e7912a18-159a-41f3-8b16-aa26dcce031b tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:08.536941 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-e7912a18-159a-41f3-8b16-aa26dcce031b tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:08.544946 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.wsgi [None req-f96ec233-5bc3-4648-bcca-15b709b4141c tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] HTTP exception thrown: Instance 74a55f26-9a9c-453f-89e5-b19794d5b414 is not attached to volume 77b0333f-f8a1-41df-85d0-712c6fc72db3 Feb 03 03:06:08.545618 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-f96ec233-5bc3-4648-bcca-15b709b4141c tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Returning 404 to user: Instance 74a55f26-9a9c-453f-89e5-b19794d5b414 is not attached to volume 77b0333f-f8a1-41df-85d0-712c6fc72db3 {{(pid=116386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 03:06:08.546525 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-f96ec233-5bc3-4648-bcca-15b709b4141c tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "DELETE /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414/os-volume_attachments/77b0333f-f8a1-41df-85d0-712c6fc72db3" status: 404 len: 154 microversion: 2.1 time: 0.089182 Feb 03 03:06:08.547151 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 513/993] 10.222.0.31 () {58 vars in 1415 bytes} [Thu Feb 3 03:06:08 2022] DELETE /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414/os-volume_attachments/77b0333f-f8a1-41df-85d0-712c6fc72db3 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 03:06:08.637444 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.objects.instance [None req-e7912a18-159a-41f3-8b16-aa26dcce031b tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lazy-loading 'services' on Instance uuid 5a4dc0b3-873e-4eff-9856-ed40da69a404 {{(pid=116385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 03 03:06:08.721634 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-e7912a18-159a-41f3-8b16-aa26dcce031b tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "DELETE /compute/v2.1/servers/5a4dc0b3-873e-4eff-9856-ed40da69a404/os-volume_attachments/18f8ce56-f5a2-4f97-88b6-a6017ff29257" status: 202 len: 0 microversion: 2.1 time: 0.196524 Feb 03 03:06:08.722390 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 481/994] 10.222.0.31 () {58 vars in 1415 bytes} [Thu Feb 3 03:06:08 2022] DELETE /compute/v2.1/servers/5a4dc0b3-873e-4eff-9856-ed40da69a404/os-volume_attachments/18f8ce56-f5a2-4f97-88b6-a6017ff29257 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 03 03:06:09.689244 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-718fb8ae-e847-4e7d-8f90-067f6a338c7f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:06:09.689774 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-718fb8ae-e847-4e7d-8f90-067f6a338c7f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:06:09.696696 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-718fb8ae-e847-4e7d-8f90-067f6a338c7f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:09.697182 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-718fb8ae-e847-4e7d-8f90-067f6a338c7f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:09.697957 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-718fb8ae-e847-4e7d-8f90-067f6a338c7f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:09.698393 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-718fb8ae-e847-4e7d-8f90-067f6a338c7f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:09.724156 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-718fb8ae-e847-4e7d-8f90-067f6a338c7f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Going to try to terminate instance {{(pid=116386) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 03 03:06:09.801438 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-718fb8ae-e847-4e7d-8f90-067f6a338c7f tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "DELETE /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 204 len: 0 microversion: 2.1 time: 0.115573 Feb 03 03:06:09.802304 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 514/995] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Feb 3 03:06:09 2022] DELETE /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 03 03:06:09.811235 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-f908f135-8741-4df8-86f4-2a584ff11d67 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:06:09.812092 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-f908f135-8741-4df8-86f4-2a584ff11d67 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:06:09.818525 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f908f135-8741-4df8-86f4-2a584ff11d67 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:09.819061 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f908f135-8741-4df8-86f4-2a584ff11d67 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:09.819941 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f908f135-8741-4df8-86f4-2a584ff11d67 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:09.820440 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-f908f135-8741-4df8-86f4-2a584ff11d67 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:09.842910 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-7f895ab9-dadb-47b1-b80d-6e7e9bdecdcc tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:06:09.843490 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-7f895ab9-dadb-47b1-b80d-6e7e9bdecdcc tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 5a4dc0b3-873e-4eff-9856-ed40da69a404] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:06:09.850050 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7f895ab9-dadb-47b1-b80d-6e7e9bdecdcc tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:09.850494 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7f895ab9-dadb-47b1-b80d-6e7e9bdecdcc tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:09.851289 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7f895ab9-dadb-47b1-b80d-6e7e9bdecdcc tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:09.851720 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7f895ab9-dadb-47b1-b80d-6e7e9bdecdcc tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:09.879029 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-7f895ab9-dadb-47b1-b80d-6e7e9bdecdcc tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 5a4dc0b3-873e-4eff-9856-ed40da69a404] Going to try to terminate instance {{(pid=116386) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 03 03:06:09.964956 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-7f895ab9-dadb-47b1-b80d-6e7e9bdecdcc tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "DELETE /compute/v2.1/servers/5a4dc0b3-873e-4eff-9856-ed40da69a404" status: 204 len: 0 microversion: 2.1 time: 0.126140 Feb 03 03:06:09.965701 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 515/996] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Feb 3 03:06:09 2022] DELETE /compute/v2.1/servers/5a4dc0b3-873e-4eff-9856-ed40da69a404 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 03 03:06:09.974712 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-81a5b6b2-a804-41ad-b6e3-06518d2c5665 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:06:09.975588 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-81a5b6b2-a804-41ad-b6e3-06518d2c5665 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 5a4dc0b3-873e-4eff-9856-ed40da69a404] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:06:09.981874 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-81a5b6b2-a804-41ad-b6e3-06518d2c5665 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:09.982315 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-81a5b6b2-a804-41ad-b6e3-06518d2c5665 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:09.983097 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-81a5b6b2-a804-41ad-b6e3-06518d2c5665 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:09.983525 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-81a5b6b2-a804-41ad-b6e3-06518d2c5665 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:10.185501 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-81a5b6b2-a804-41ad-b6e3-06518d2c5665 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c8680f685446b2b96aaea84587b7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c17e83a1e6491b9caecd968321a263', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:06:10.186086 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-f908f135-8741-4df8-86f4-2a584ff11d67 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:06:10.193553 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-81a5b6b2-a804-41ad-b6e3-06518d2c5665 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "GET /compute/v2.1/servers/5a4dc0b3-873e-4eff-9856-ed40da69a404" status: 200 len: 1514 microversion: 2.1 time: 0.223141 Feb 03 03:06:10.193754 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-f908f135-8741-4df8-86f4-2a584ff11d67 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1555 microversion: 2.1 time: 0.386773 Feb 03 03:06:10.194125 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 516/997] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:06:09 2022] GET /compute/v2.1/servers/5a4dc0b3-873e-4eff-9856-ed40da69a404 => generated 1514 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:06:10.194382 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 482/998] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:06:09 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1555 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:06:11.212831 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-a736b950-b8da-4c80-a350-f1fb37518c9a tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:06:11.213543 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-a736b950-b8da-4c80-a350-f1fb37518c9a tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 5a4dc0b3-873e-4eff-9856-ed40da69a404] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:06:11.213856 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-b0a2021b-cde1-4faf-906f-630e5497e0a3 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:06:11.214544 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-b0a2021b-cde1-4faf-906f-630e5497e0a3 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:06:11.220844 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a736b950-b8da-4c80-a350-f1fb37518c9a tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:11.221313 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a736b950-b8da-4c80-a350-f1fb37518c9a tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:11.221655 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b0a2021b-cde1-4faf-906f-630e5497e0a3 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:11.222122 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b0a2021b-cde1-4faf-906f-630e5497e0a3 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:11.222286 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a736b950-b8da-4c80-a350-f1fb37518c9a tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:11.222567 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-a736b950-b8da-4c80-a350-f1fb37518c9a tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:11.222924 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b0a2021b-cde1-4faf-906f-630e5497e0a3 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:11.223369 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b0a2021b-cde1-4faf-906f-630e5497e0a3 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:11.417491 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-a736b950-b8da-4c80-a350-f1fb37518c9a tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c8680f685446b2b96aaea84587b7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c17e83a1e6491b9caecd968321a263', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:06:11.420530 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-b0a2021b-cde1-4faf-906f-630e5497e0a3 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:06:11.428939 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-b0a2021b-cde1-4faf-906f-630e5497e0a3 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1555 microversion: 2.1 time: 0.219049 Feb 03 03:06:11.429932 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 517/999] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:06:11 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1555 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:06:11.430077 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-a736b950-b8da-4c80-a350-f1fb37518c9a tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "GET /compute/v2.1/servers/5a4dc0b3-873e-4eff-9856-ed40da69a404" status: 200 len: 1514 microversion: 2.1 time: 0.221961 Feb 03 03:06:11.430526 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 483/1000] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:06:11 2022] GET /compute/v2.1/servers/5a4dc0b3-873e-4eff-9856-ed40da69a404 => generated 1514 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:06:12.116502 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-4e734fa9-9704-470a-92c4-be9b12ac70a9 req-d780b083-e318-4087-9eb0-f09a99773efc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a4dc0b3-873e-4eff-9856-ed40da69a404", "name": "network-vif-deleted", "tag": "c4be19ca-7543-4609-b13c-a0b0a73f0618"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:06:12.118474 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:06:12.118474 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 03:06:12.127638 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-4b71eb5e-801b-44a5-9a80-3727908ff943 req-c3429068-1ef3-4f31-9d81-419858206487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74a55f26-9a9c-453f-89e5-b19794d5b414", "name": "network-vif-deleted", "tag": "9ec67dbd-d798-42d9-982f-ae69f4d47df6"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:06:12.131702 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-4e734fa9-9704-470a-92c4-be9b12ac70a9 req-d780b083-e318-4087-9eb0-f09a99773efc service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:12.131892 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:06:12.131892 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:06:12.132569 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-4e734fa9-9704-470a-92c4-be9b12ac70a9 req-d780b083-e318-4087-9eb0-f09a99773efc service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:12.145723 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-4b71eb5e-801b-44a5-9a80-3727908ff943 req-c3429068-1ef3-4f31-9d81-419858206487 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:12.147001 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-4b71eb5e-801b-44a5-9a80-3727908ff943 req-c3429068-1ef3-4f31-9d81-419858206487 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:12.156114 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-4e734fa9-9704-470a-92c4-be9b12ac70a9 req-d780b083-e318-4087-9eb0-f09a99773efc service nova] Creating event network-vif-deleted:c4be19ca-7543-4609-b13c-a0b0a73f0618 for instance 5a4dc0b3-873e-4eff-9856-ed40da69a404 on hv-cinder-82758 Feb 03 03:06:12.164104 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-4e734fa9-9704-470a-92c4-be9b12ac70a9 req-d780b083-e318-4087-9eb0-f09a99773efc service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054370 Feb 03 03:06:12.165386 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 518/1001] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:06:12.166980 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-4b71eb5e-801b-44a5-9a80-3727908ff943 req-c3429068-1ef3-4f31-9d81-419858206487 service nova] Creating event network-vif-deleted:9ec67dbd-d798-42d9-982f-ae69f4d47df6 for instance 74a55f26-9a9c-453f-89e5-b19794d5b414 on hv-cinder-82758 Feb 03 03:06:12.175208 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-4b71eb5e-801b-44a5-9a80-3727908ff943 req-c3429068-1ef3-4f31-9d81-419858206487 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055874 Feb 03 03:06:12.177140 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 484/1002] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:06:12.447819 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-980b067c-e2dc-49e6-8940-bee5c6c9fa81 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:06:12.448378 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-63ab957a-ad11-429e-be63-ff31e9ef0828 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:06:12.448761 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-63ab957a-ad11-429e-be63-ff31e9ef0828 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:06:12.449657 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-980b067c-e2dc-49e6-8940-bee5c6c9fa81 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 5a4dc0b3-873e-4eff-9856-ed40da69a404] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:06:12.455559 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-63ab957a-ad11-429e-be63-ff31e9ef0828 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:12.456009 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-63ab957a-ad11-429e-be63-ff31e9ef0828 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:12.456267 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-980b067c-e2dc-49e6-8940-bee5c6c9fa81 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:12.456706 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-980b067c-e2dc-49e6-8940-bee5c6c9fa81 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:12.456868 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-63ab957a-ad11-429e-be63-ff31e9ef0828 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:12.457391 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-63ab957a-ad11-429e-be63-ff31e9ef0828 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:12.457557 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-980b067c-e2dc-49e6-8940-bee5c6c9fa81 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:12.457896 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-980b067c-e2dc-49e6-8940-bee5c6c9fa81 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:12.491608 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-980b067c-e2dc-49e6-8940-bee5c6c9fa81 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:12.492214 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-980b067c-e2dc-49e6-8940-bee5c6c9fa81 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:12.492754 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.objects.instance [None req-980b067c-e2dc-49e6-8940-bee5c6c9fa81 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lazy-loading 'fault' on Instance uuid 5a4dc0b3-873e-4eff-9856-ed40da69a404 {{(pid=116386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 03 03:06:12.492932 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-63ab957a-ad11-429e-be63-ff31e9ef0828 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:12.493205 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-63ab957a-ad11-429e-be63-ff31e9ef0828 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:12.493652 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.objects.instance [None req-63ab957a-ad11-429e-be63-ff31e9ef0828 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lazy-loading 'fault' on Instance uuid 74a55f26-9a9c-453f-89e5-b19794d5b414 {{(pid=116385) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 03 03:06:12.584234 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-980b067c-e2dc-49e6-8940-bee5c6c9fa81 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04c8680f685446b2b96aaea84587b7bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3c17e83a1e6491b9caecd968321a263', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:06:12.585858 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-63ab957a-ad11-429e-be63-ff31e9ef0828 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4ba512a106549b2b072c40fd33bebcb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a68a1b96ee4033bf683db87d2c6cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:06:12.594488 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-63ab957a-ad11-429e-be63-ff31e9ef0828 tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 200 len: 1349 microversion: 2.1 time: 0.151257 Feb 03 03:06:12.595487 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 485/1003] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:06:12 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 1349 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:06:12.596943 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-980b067c-e2dc-49e6-8940-bee5c6c9fa81 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "GET /compute/v2.1/servers/5a4dc0b3-873e-4eff-9856-ed40da69a404" status: 200 len: 1309 microversion: 2.1 time: 0.153393 Feb 03 03:06:12.607910 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 519/1004] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:06:12 2022] GET /compute/v2.1/servers/5a4dc0b3-873e-4eff-9856-ed40da69a404 => generated 1309 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:06:13.611679 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-c7af750d-089f-4272-bce7-5866364fb84c tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:06:13.612309 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-c7af750d-089f-4272-bce7-5866364fb84c tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] [instance: 74a55f26-9a9c-453f-89e5-b19794d5b414] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:06:13.614602 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-ae611438-b372-4b76-99ac-7e70500110a5 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:06:13.615753 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-ae611438-b372-4b76-99ac-7e70500110a5 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] [instance: 5a4dc0b3-873e-4eff-9856-ed40da69a404] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:06:13.618727 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c7af750d-089f-4272-bce7-5866364fb84c tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:13.619196 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c7af750d-089f-4272-bce7-5866364fb84c tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:13.620375 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c7af750d-089f-4272-bce7-5866364fb84c tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:13.620823 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-c7af750d-089f-4272-bce7-5866364fb84c tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:13.622941 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ae611438-b372-4b76-99ac-7e70500110a5 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:13.623435 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ae611438-b372-4b76-99ac-7e70500110a5 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:13.624426 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ae611438-b372-4b76-99ac-7e70500110a5 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:13.625087 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ae611438-b372-4b76-99ac-7e70500110a5 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:13.634441 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.wsgi [None req-c7af750d-089f-4272-bce7-5866364fb84c tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] HTTP exception thrown: Instance 74a55f26-9a9c-453f-89e5-b19794d5b414 could not be found. Feb 03 03:06:13.635275 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-c7af750d-089f-4272-bce7-5866364fb84c tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Returning 404 to user: Instance 74a55f26-9a9c-453f-89e5-b19794d5b414 could not be found. {{(pid=116385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 03:06:13.636113 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-c7af750d-089f-4272-bce7-5866364fb84c tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414" status: 404 len: 111 microversion: 2.1 time: 0.028412 Feb 03 03:06:13.636645 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 486/1005] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:06:13 2022] GET /compute/v2.1/servers/74a55f26-9a9c-453f-89e5-b19794d5b414 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 03:06:13.641364 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.wsgi [None req-ae611438-b372-4b76-99ac-7e70500110a5 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] HTTP exception thrown: Instance 5a4dc0b3-873e-4eff-9856-ed40da69a404 could not be found. Feb 03 03:06:13.642178 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-ae611438-b372-4b76-99ac-7e70500110a5 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] Returning 404 to user: Instance 5a4dc0b3-873e-4eff-9856-ed40da69a404 could not be found. {{(pid=116386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 03:06:13.643000 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-ae611438-b372-4b76-99ac-7e70500110a5 tempest-VolumesSnapshotTestJSON-731130571 tempest-VolumesSnapshotTestJSON-731130571-project] 10.222.0.31 "GET /compute/v2.1/servers/5a4dc0b3-873e-4eff-9856-ed40da69a404" status: 404 len: 111 microversion: 2.1 time: 0.032311 Feb 03 03:06:13.643531 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 520/1006] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:06:13 2022] GET /compute/v2.1/servers/5a4dc0b3-873e-4eff-9856-ed40da69a404 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 03 03:06:13.644691 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-c05f7631-a8a2-4a7c-91b9-c456a8f373be tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] Calling method '.version_select at 0x7ff99cf180d0>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:06:13.667452 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-c05f7631-a8a2-4a7c-91b9-c456a8f373be tempest-TestMinimumBasicScenario-1383127318 tempest-TestMinimumBasicScenario-1383127318-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1061946084" status: 202 len: 0 microversion: 2.1 time: 0.026004 Feb 03 03:06:13.671304 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 487/1007] 10.222.0.31 () {58 vars in 1271 bytes} [Thu Feb 3 03:06:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1061946084 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 03 03:06:27.471897 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 03 03:06:27.472857 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: Thu Feb 3 03:06:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 03 03:06:36.035594 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 03 03:06:36.036902 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: Thu Feb 3 03:06:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 03 03:06:52.208663 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-b90a1918-5ad5-4d4d-8e4b-ce62fe5f7d39 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1396321040", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1043137288", "security_groups": [{"name": "tempest-secgroup-smoke-1844821108"}], "block_device_mapping_v2": [{"uuid": "9024363a-b37b-4eac-86f2-9d75ffce2cbc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1f509aa5-ebd0-421b-bf85-c9ee605b4c0c"}]}} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:06:52.513349 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.network.neutron [None req-b90a1918-5ad5-4d4d-8e4b-ce62fe5f7d39 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] validate_networks() for [('1f509aa5-ebd0-421b-bf85-c9ee605b4c0c', None, None, None, None, None)] {{(pid=116386) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Feb 03 03:06:52.950552 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-b90a1918-5ad5-4d4d-8e4b-ce62fe5f7d39 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Flavor limits 0:0:0 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 03 03:06:52.950991 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-b90a1918-5ad5-4d4d-8e4b-ce62fe5f7d39 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Image limits 0:0:0 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 03 03:06:52.951679 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-b90a1918-5ad5-4d4d-8e4b-ce62fe5f7d39 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Flavor pref 0:0:0 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 03 03:06:52.952345 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-b90a1918-5ad5-4d4d-8e4b-ce62fe5f7d39 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Image pref 0:0:0 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 03 03:06:52.953112 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.virt.hardware [None req-b90a1918-5ad5-4d4d-8e4b-ce62fe5f7d39 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 03 03:06:52.964392 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b90a1918-5ad5-4d4d-8e4b-ce62fe5f7d39 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:52.965219 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b90a1918-5ad5-4d4d-8e4b-ce62fe5f7d39 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:52.966030 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b90a1918-5ad5-4d4d-8e4b-ce62fe5f7d39 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:52.966465 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-b90a1918-5ad5-4d4d-8e4b-ce62fe5f7d39 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:52.983518 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.quota [None req-b90a1918-5ad5-4d4d-8e4b-ce62fe5f7d39 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Getting quotas for project 264ee2f5b580483c85a302041b05c23f. Resources: {'cores', 'ram', 'instances'} {{(pid=116386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 03 03:06:52.988212 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.quota [None req-b90a1918-5ad5-4d4d-8e4b-ce62fe5f7d39 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Getting quotas for user 6a97115409ba4be989f9071c61df79a5 and project 264ee2f5b580483c85a302041b05c23f. Resources: {'cores', 'ram', 'instances'} {{(pid=116386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 03 03:06:53.044009 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-b90a1918-5ad5-4d4d-8e4b-ce62fe5f7d39 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Going to run 1 instances... {{(pid=116386) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 03 03:06:53.046149 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-b90a1918-5ad5-4d4d-8e4b-ce62fe5f7d39 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 9c86702d-1cc3-43e7-953f-27a9779a3f21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9024363a-b37b-4eac-86f2-9d75ffce2cbc',volume_size=None,volume_type=None)] {{(pid=116386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 03 03:06:53.174481 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-b90a1918-5ad5-4d4d-8e4b-ce62fe5f7d39 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.969732 Feb 03 03:06:53.175122 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 521/1008] 10.222.0.31 () {60 vars in 1146 bytes} [Thu Feb 3 03:06:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 03 03:06:53.185311 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-68da9fcc-c168-4620-aee1-4f5740e92cb0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:06:53.185990 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-68da9fcc-c168-4620-aee1-4f5740e92cb0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 9c86702d-1cc3-43e7-953f-27a9779a3f21] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:06:53.290036 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-68da9fcc-c168-4620-aee1-4f5740e92cb0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:06:53.296839 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-68da9fcc-c168-4620-aee1-4f5740e92cb0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21" status: 200 len: 1095 microversion: 2.1 time: 0.115484 Feb 03 03:06:53.297417 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 488/1009] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:06:53 2022] GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21 => generated 1095 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:06:54.314123 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-7a0b5ba1-8fc0-4a13-a949-334f2e306119 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:06:54.315820 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-7a0b5ba1-8fc0-4a13-a949-334f2e306119 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 9c86702d-1cc3-43e7-953f-27a9779a3f21] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:06:54.322155 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7a0b5ba1-8fc0-4a13-a949-334f2e306119 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:54.322602 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7a0b5ba1-8fc0-4a13-a949-334f2e306119 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:54.324025 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7a0b5ba1-8fc0-4a13-a949-334f2e306119 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:54.324457 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-7a0b5ba1-8fc0-4a13-a949-334f2e306119 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:54.394882 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-7a0b5ba1-8fc0-4a13-a949-334f2e306119 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:06:54.405278 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-7a0b5ba1-8fc0-4a13-a949-334f2e306119 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21" status: 200 len: 1211 microversion: 2.1 time: 0.095445 Feb 03 03:06:54.407337 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 522/1010] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:06:54 2022] GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21 => generated 1211 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:06:55.427691 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-250c5502-8bba-4b95-b134-9db20c0c8bf5 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:06:55.428306 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-250c5502-8bba-4b95-b134-9db20c0c8bf5 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 9c86702d-1cc3-43e7-953f-27a9779a3f21] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:06:55.435031 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-250c5502-8bba-4b95-b134-9db20c0c8bf5 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:55.435421 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-250c5502-8bba-4b95-b134-9db20c0c8bf5 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:55.436289 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-250c5502-8bba-4b95-b134-9db20c0c8bf5 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:55.436612 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-250c5502-8bba-4b95-b134-9db20c0c8bf5 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:55.602962 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [req-ed214c0f-c8a3-4c2a-bd0c-f95c679a34d0 req-574449a8-630b-471d-9bbe-61d8df292369 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c86702d-1cc3-43e7-953f-27a9779a3f21", "tag": "b846ee16-d1e4-4a62-87e1-a9c1e7a9ecf7"}]} {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:06:55.607159 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:06:55.607159 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: warnings.warn(msg) Feb 03 03:06:55.616522 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-ed214c0f-c8a3-4c2a-bd0c-f95c679a34d0 req-574449a8-630b-471d-9bbe-61d8df292369 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:55.617425 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [req-ed214c0f-c8a3-4c2a-bd0c-f95c679a34d0 req-574449a8-630b-471d-9bbe-61d8df292369 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:55.630963 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.compute.server_external_events [req-ed214c0f-c8a3-4c2a-bd0c-f95c679a34d0 req-574449a8-630b-471d-9bbe-61d8df292369 service nova] Creating event network-changed:b846ee16-d1e4-4a62-87e1-a9c1e7a9ecf7 for instance 9c86702d-1cc3-43e7-953f-27a9779a3f21 on hv-cinder-82758 Feb 03 03:06:55.638211 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [req-ed214c0f-c8a3-4c2a-bd0c-f95c679a34d0 req-574449a8-630b-471d-9bbe-61d8df292369 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039405 Feb 03 03:06:55.638975 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 523/1011] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:06:55.969266 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-250c5502-8bba-4b95-b134-9db20c0c8bf5 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:06:55.979439 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-250c5502-8bba-4b95-b134-9db20c0c8bf5 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21" status: 200 len: 1267 microversion: 2.1 time: 0.555331 Feb 03 03:06:55.981543 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 489/1012] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:06:55 2022] GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21 => generated 1267 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:06:57.002538 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-e75aa31a-7412-4b69-8856-17d13ee7fcda tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:06:57.003480 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-e75aa31a-7412-4b69-8856-17d13ee7fcda tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 9c86702d-1cc3-43e7-953f-27a9779a3f21] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:06:57.011508 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e75aa31a-7412-4b69-8856-17d13ee7fcda tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:57.011947 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e75aa31a-7412-4b69-8856-17d13ee7fcda tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:57.012732 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e75aa31a-7412-4b69-8856-17d13ee7fcda tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:57.013229 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-e75aa31a-7412-4b69-8856-17d13ee7fcda tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:57.157286 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-e75aa31a-7412-4b69-8856-17d13ee7fcda tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:06:57.164885 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-e75aa31a-7412-4b69-8856-17d13ee7fcda tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21" status: 200 len: 1267 microversion: 2.1 time: 0.169610 Feb 03 03:06:57.165448 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 524/1013] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:06:56 2022] GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:06:58.187283 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-dee20ee7-cd24-4fa0-a1a6-f084bde77700 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:06:58.187890 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-dee20ee7-cd24-4fa0-a1a6-f084bde77700 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 9c86702d-1cc3-43e7-953f-27a9779a3f21] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:06:58.194620 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-dee20ee7-cd24-4fa0-a1a6-f084bde77700 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:58.195068 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-dee20ee7-cd24-4fa0-a1a6-f084bde77700 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:58.195841 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-dee20ee7-cd24-4fa0-a1a6-f084bde77700 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:58.196281 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-dee20ee7-cd24-4fa0-a1a6-f084bde77700 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:58.340166 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-dee20ee7-cd24-4fa0-a1a6-f084bde77700 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:06:58.351460 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-dee20ee7-cd24-4fa0-a1a6-f084bde77700 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21" status: 200 len: 1267 microversion: 2.1 time: 0.167956 Feb 03 03:06:58.352013 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 490/1014] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:06:58 2022] GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:06:59.371924 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-1eb3389a-e7ad-421a-af3c-d3965ae22451 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:06:59.372819 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-1eb3389a-e7ad-421a-af3c-d3965ae22451 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 9c86702d-1cc3-43e7-953f-27a9779a3f21] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:06:59.382687 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1eb3389a-e7ad-421a-af3c-d3965ae22451 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:59.383135 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1eb3389a-e7ad-421a-af3c-d3965ae22451 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:59.383904 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1eb3389a-e7ad-421a-af3c-d3965ae22451 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:06:59.384332 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-1eb3389a-e7ad-421a-af3c-d3965ae22451 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:06:59.531006 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-1eb3389a-e7ad-421a-af3c-d3965ae22451 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:06:59.538418 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-1eb3389a-e7ad-421a-af3c-d3965ae22451 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21" status: 200 len: 1267 microversion: 2.1 time: 0.173070 Feb 03 03:06:59.538968 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 525/1015] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:06:59 2022] GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:07:00.564661 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-d3cb4218-ba0d-4abc-b158-11233c323102 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:07:00.565711 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-d3cb4218-ba0d-4abc-b158-11233c323102 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 9c86702d-1cc3-43e7-953f-27a9779a3f21] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:07:00.573928 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d3cb4218-ba0d-4abc-b158-11233c323102 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:07:00.574379 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d3cb4218-ba0d-4abc-b158-11233c323102 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:07:00.575148 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d3cb4218-ba0d-4abc-b158-11233c323102 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:07:00.575575 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d3cb4218-ba0d-4abc-b158-11233c323102 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:07:00.719912 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-d3cb4218-ba0d-4abc-b158-11233c323102 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:07:00.728514 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-d3cb4218-ba0d-4abc-b158-11233c323102 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21" status: 200 len: 1267 microversion: 2.1 time: 0.169902 Feb 03 03:07:00.729415 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 491/1016] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:07:00 2022] GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:07:01.751595 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-f9fb70d0-8295-494c-8568-5d35897b1a45 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:07:01.752366 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-f9fb70d0-8295-494c-8568-5d35897b1a45 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 9c86702d-1cc3-43e7-953f-27a9779a3f21] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:07:01.762111 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f9fb70d0-8295-494c-8568-5d35897b1a45 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:07:01.762551 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f9fb70d0-8295-494c-8568-5d35897b1a45 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:07:01.763488 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f9fb70d0-8295-494c-8568-5d35897b1a45 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:07:01.764225 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-f9fb70d0-8295-494c-8568-5d35897b1a45 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:07:01.918278 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-f9fb70d0-8295-494c-8568-5d35897b1a45 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:07:01.930659 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-f9fb70d0-8295-494c-8568-5d35897b1a45 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21" status: 200 len: 1267 microversion: 2.1 time: 0.183176 Feb 03 03:07:01.931226 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 526/1017] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:07:01 2022] GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21 => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:07:02.951848 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-63c86972-8ea3-4a12-8514-5dafc562cd56 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:07:02.952920 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-63c86972-8ea3-4a12-8514-5dafc562cd56 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 9c86702d-1cc3-43e7-953f-27a9779a3f21] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:07:02.963219 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-63c86972-8ea3-4a12-8514-5dafc562cd56 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:07:02.963964 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-63c86972-8ea3-4a12-8514-5dafc562cd56 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:07:02.965684 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-63c86972-8ea3-4a12-8514-5dafc562cd56 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:07:02.966403 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-63c86972-8ea3-4a12-8514-5dafc562cd56 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:07:03.111681 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-63c86972-8ea3-4a12-8514-5dafc562cd56 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:07:03.119087 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-63c86972-8ea3-4a12-8514-5dafc562cd56 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21" status: 200 len: 1267 microversion: 2.1 time: 0.173954 Feb 03 03:07:03.119680 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 492/1018] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:07:02 2022] GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:07:04.139772 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-ac72d6bd-f5df-46bc-8344-99c6caddd05d tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:07:04.140759 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-ac72d6bd-f5df-46bc-8344-99c6caddd05d tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 9c86702d-1cc3-43e7-953f-27a9779a3f21] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:07:04.150838 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ac72d6bd-f5df-46bc-8344-99c6caddd05d tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:07:04.151289 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ac72d6bd-f5df-46bc-8344-99c6caddd05d tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:07:04.152071 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ac72d6bd-f5df-46bc-8344-99c6caddd05d tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:07:04.152504 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ac72d6bd-f5df-46bc-8344-99c6caddd05d tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:07:04.302728 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-ac72d6bd-f5df-46bc-8344-99c6caddd05d tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:07:04.314237 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-ac72d6bd-f5df-46bc-8344-99c6caddd05d tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21" status: 200 len: 1267 microversion: 2.1 time: 0.180310 Feb 03 03:07:04.315017 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 527/1019] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:07:04 2022] GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:07:05.335801 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-731a0ddd-1f17-4fbf-9b82-a5ce08c9e875 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:07:05.336702 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-731a0ddd-1f17-4fbf-9b82-a5ce08c9e875 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 9c86702d-1cc3-43e7-953f-27a9779a3f21] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:07:05.347761 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-731a0ddd-1f17-4fbf-9b82-a5ce08c9e875 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:07:05.348511 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-731a0ddd-1f17-4fbf-9b82-a5ce08c9e875 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:07:05.349840 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-731a0ddd-1f17-4fbf-9b82-a5ce08c9e875 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:07:05.350565 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-731a0ddd-1f17-4fbf-9b82-a5ce08c9e875 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:07:05.491255 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-731a0ddd-1f17-4fbf-9b82-a5ce08c9e875 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:07:05.498793 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-731a0ddd-1f17-4fbf-9b82-a5ce08c9e875 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21" status: 200 len: 1267 microversion: 2.1 time: 0.169454 Feb 03 03:07:05.499332 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 493/1020] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:07:05 2022] GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:07:06.519069 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-48e1691f-a352-406f-8066-adfd7113d579 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:07:06.520073 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-48e1691f-a352-406f-8066-adfd7113d579 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 9c86702d-1cc3-43e7-953f-27a9779a3f21] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:07:06.528480 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-48e1691f-a352-406f-8066-adfd7113d579 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:07:06.528950 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-48e1691f-a352-406f-8066-adfd7113d579 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:07:06.529731 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-48e1691f-a352-406f-8066-adfd7113d579 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:07:06.530162 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-48e1691f-a352-406f-8066-adfd7113d579 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:07:06.663616 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-48e1691f-a352-406f-8066-adfd7113d579 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:07:06.671218 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-48e1691f-a352-406f-8066-adfd7113d579 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21" status: 200 len: 1267 microversion: 2.1 time: 0.158334 Feb 03 03:07:06.671780 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 528/1021] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:07:06 2022] GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:07:06.704235 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-da397b70-39dd-43de-a0cc-4dd8b943ae43 req-c9d0f0ba-65ca-4987-bd03-b09203fef2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c86702d-1cc3-43e7-953f-27a9779a3f21", "name": "network-vif-plugged", "status": "completed", "tag": "b846ee16-d1e4-4a62-87e1-a9c1e7a9ecf7"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:07:06.705812 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:07:06.705812 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:07:06.713508 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-da397b70-39dd-43de-a0cc-4dd8b943ae43 req-c9d0f0ba-65ca-4987-bd03-b09203fef2f5 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:07:06.714988 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-da397b70-39dd-43de-a0cc-4dd8b943ae43 req-c9d0f0ba-65ca-4987-bd03-b09203fef2f5 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:07:06.726601 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-da397b70-39dd-43de-a0cc-4dd8b943ae43 req-c9d0f0ba-65ca-4987-bd03-b09203fef2f5 service nova] Creating event network-vif-plugged:b846ee16-d1e4-4a62-87e1-a9c1e7a9ecf7 for instance 9c86702d-1cc3-43e7-953f-27a9779a3f21 on hv-cinder-82758 Feb 03 03:07:06.731679 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-da397b70-39dd-43de-a0cc-4dd8b943ae43 req-c9d0f0ba-65ca-4987-bd03-b09203fef2f5 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031110 Feb 03 03:07:06.732257 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 494/1022] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:07:07.757458 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-ecbb95f1-435b-43c2-87d3-dcb220a7ae07 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:07:07.758090 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-ecbb95f1-435b-43c2-87d3-dcb220a7ae07 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 9c86702d-1cc3-43e7-953f-27a9779a3f21] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:07:07.767321 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ecbb95f1-435b-43c2-87d3-dcb220a7ae07 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:07:07.767880 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ecbb95f1-435b-43c2-87d3-dcb220a7ae07 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:07:07.769111 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ecbb95f1-435b-43c2-87d3-dcb220a7ae07 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:07:07.769631 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-ecbb95f1-435b-43c2-87d3-dcb220a7ae07 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:07:07.907827 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-ecbb95f1-435b-43c2-87d3-dcb220a7ae07 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:07:07.915679 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-ecbb95f1-435b-43c2-87d3-dcb220a7ae07 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21" status: 200 len: 1267 microversion: 2.1 time: 0.229893 Feb 03 03:07:07.916242 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 529/1023] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:07:07 2022] GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21 => generated 1267 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:07:08.937126 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-2e9bb0a7-f6e3-4558-ae58-3cad173243af tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:07:08.938726 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-2e9bb0a7-f6e3-4558-ae58-3cad173243af tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 9c86702d-1cc3-43e7-953f-27a9779a3f21] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:07:08.950423 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2e9bb0a7-f6e3-4558-ae58-3cad173243af tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:07:08.950863 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2e9bb0a7-f6e3-4558-ae58-3cad173243af tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:07:08.951684 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2e9bb0a7-f6e3-4558-ae58-3cad173243af tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:07:08.952169 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-2e9bb0a7-f6e3-4558-ae58-3cad173243af tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:07:09.090610 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-2e9bb0a7-f6e3-4558-ae58-3cad173243af tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:07:09.098480 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-2e9bb0a7-f6e3-4558-ae58-3cad173243af tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21" status: 200 len: 1455 microversion: 2.1 time: 0.168096 Feb 03 03:07:09.099037 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 495/1024] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:07:08 2022] GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21 => generated 1455 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:07:09.114583 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-66132af1-d361-4b80-87e4-3f94ba832661 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:07:09.115198 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-66132af1-d361-4b80-87e4-3f94ba832661 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 9c86702d-1cc3-43e7-953f-27a9779a3f21] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:07:09.121985 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-66132af1-d361-4b80-87e4-3f94ba832661 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:07:09.122427 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-66132af1-d361-4b80-87e4-3f94ba832661 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:07:09.123209 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-66132af1-d361-4b80-87e4-3f94ba832661 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:07:09.123630 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-66132af1-d361-4b80-87e4-3f94ba832661 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:07:09.287056 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-66132af1-d361-4b80-87e4-3f94ba832661 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:07:09.296419 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-66132af1-d361-4b80-87e4-3f94ba832661 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21" status: 200 len: 1455 microversion: 2.1 time: 0.185534 Feb 03 03:07:09.297038 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 530/1025] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:07:09 2022] GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21 => generated 1455 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:07:10.991606 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-0caf49aa-e527-4c6f-b13e-9e0f8187d4a5 req-d7e6b2e1-7c54-45d3-aa23-f9318e3a918f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c86702d-1cc3-43e7-953f-27a9779a3f21", "tag": "b846ee16-d1e4-4a62-87e1-a9c1e7a9ecf7"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:07:10.993454 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:07:10.993454 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:07:11.000325 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-0caf49aa-e527-4c6f-b13e-9e0f8187d4a5 req-d7e6b2e1-7c54-45d3-aa23-f9318e3a918f service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:07:11.000791 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-0caf49aa-e527-4c6f-b13e-9e0f8187d4a5 req-d7e6b2e1-7c54-45d3-aa23-f9318e3a918f service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:07:11.011558 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-0caf49aa-e527-4c6f-b13e-9e0f8187d4a5 req-d7e6b2e1-7c54-45d3-aa23-f9318e3a918f service nova] Creating event network-changed:b846ee16-d1e4-4a62-87e1-a9c1e7a9ecf7 for instance 9c86702d-1cc3-43e7-953f-27a9779a3f21 on hv-cinder-82758 Feb 03 03:07:11.016654 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-0caf49aa-e527-4c6f-b13e-9e0f8187d4a5 req-d7e6b2e1-7c54-45d3-aa23-f9318e3a918f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087597 Feb 03 03:07:11.017210 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 496/1026] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:08:50.747865 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-3245f286-ac1e-42a4-b5b5-3f5e3b983a4a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:08:50.748392 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-3245f286-ac1e-42a4-b5b5-3f5e3b983a4a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 9c86702d-1cc3-43e7-953f-27a9779a3f21] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:08:50.751486 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-1c06bbe2-b316-49bd-951d-073ec60b9f1b req-fba6a1b2-4f4c-47d7-9a49-d91cf95e4377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c86702d-1cc3-43e7-953f-27a9779a3f21", "tag": "b846ee16-d1e4-4a62-87e1-a9c1e7a9ecf7"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:08:50.753032 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:08:50.753032 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:08:50.755072 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3245f286-ac1e-42a4-b5b5-3f5e3b983a4a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:08:50.755522 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3245f286-ac1e-42a4-b5b5-3f5e3b983a4a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:08:50.756286 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3245f286-ac1e-42a4-b5b5-3f5e3b983a4a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:08:50.756989 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-3245f286-ac1e-42a4-b5b5-3f5e3b983a4a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:08:50.760874 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-1c06bbe2-b316-49bd-951d-073ec60b9f1b req-fba6a1b2-4f4c-47d7-9a49-d91cf95e4377 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:08:50.761314 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-1c06bbe2-b316-49bd-951d-073ec60b9f1b req-fba6a1b2-4f4c-47d7-9a49-d91cf95e4377 service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:08:50.777312 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-1c06bbe2-b316-49bd-951d-073ec60b9f1b req-fba6a1b2-4f4c-47d7-9a49-d91cf95e4377 service nova] Creating event network-changed:b846ee16-d1e4-4a62-87e1-a9c1e7a9ecf7 for instance 9c86702d-1cc3-43e7-953f-27a9779a3f21 on hv-cinder-82758 Feb 03 03:08:50.782503 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-1c06bbe2-b316-49bd-951d-073ec60b9f1b req-fba6a1b2-4f4c-47d7-9a49-d91cf95e4377 service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036339 Feb 03 03:08:50.783343 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 497/1027] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:08:50.784551 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-3245f286-ac1e-42a4-b5b5-3f5e3b983a4a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 9c86702d-1cc3-43e7-953f-27a9779a3f21] Going to try to terminate instance {{(pid=116386) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 03 03:08:50.872362 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-3245f286-ac1e-42a4-b5b5-3f5e3b983a4a tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "DELETE /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21" status: 204 len: 0 microversion: 2.1 time: 0.128572 Feb 03 03:08:50.873322 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 531/1028] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Feb 3 03:08:50 2022] DELETE /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 03 03:08:50.881923 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-5a7a72ee-5b9f-4656-9195-35ee757cb1ba tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:08:50.882769 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-5a7a72ee-5b9f-4656-9195-35ee757cb1ba tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 9c86702d-1cc3-43e7-953f-27a9779a3f21] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:08:50.889908 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5a7a72ee-5b9f-4656-9195-35ee757cb1ba tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:08:50.890686 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5a7a72ee-5b9f-4656-9195-35ee757cb1ba tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:08:50.891472 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5a7a72ee-5b9f-4656-9195-35ee757cb1ba tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:08:50.891899 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5a7a72ee-5b9f-4656-9195-35ee757cb1ba tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:08:51.128114 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-5a7a72ee-5b9f-4656-9195-35ee757cb1ba tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:08:51.135709 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-5a7a72ee-5b9f-4656-9195-35ee757cb1ba tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21" status: 200 len: 1580 microversion: 2.1 time: 0.257841 Feb 03 03:08:51.141280 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 498/1029] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:08:50 2022] GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21 => generated 1580 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:08:52.155201 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-a5c9600b-421e-4bf8-aa84-08cbae47c9e3 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:08:52.156177 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-a5c9600b-421e-4bf8-aa84-08cbae47c9e3 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 9c86702d-1cc3-43e7-953f-27a9779a3f21] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:08:52.162961 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a5c9600b-421e-4bf8-aa84-08cbae47c9e3 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:08:52.163406 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a5c9600b-421e-4bf8-aa84-08cbae47c9e3 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:08:52.164192 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a5c9600b-421e-4bf8-aa84-08cbae47c9e3 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:08:52.164634 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-a5c9600b-421e-4bf8-aa84-08cbae47c9e3 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:08:52.305157 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-a5c9600b-421e-4bf8-aa84-08cbae47c9e3 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:08:52.313345 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-a5c9600b-421e-4bf8-aa84-08cbae47c9e3 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21" status: 200 len: 1461 microversion: 2.1 time: 0.163017 Feb 03 03:08:52.313969 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 532/1030] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:08:52 2022] GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21 => generated 1461 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:08:52.931970 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-9edb4a28-f8ac-47ce-b5b9-cf23b4fe6b39 req-5adc721b-b7ca-4424-a1b2-1ddf9f104d0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c86702d-1cc3-43e7-953f-27a9779a3f21", "name": "network-vif-deleted", "tag": "b846ee16-d1e4-4a62-87e1-a9c1e7a9ecf7"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:08:52.933506 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:08:52.933506 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:08:52.940796 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-9edb4a28-f8ac-47ce-b5b9-cf23b4fe6b39 req-5adc721b-b7ca-4424-a1b2-1ddf9f104d0d service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:08:52.941302 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-9edb4a28-f8ac-47ce-b5b9-cf23b4fe6b39 req-5adc721b-b7ca-4424-a1b2-1ddf9f104d0d service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:08:52.952806 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-9edb4a28-f8ac-47ce-b5b9-cf23b4fe6b39 req-5adc721b-b7ca-4424-a1b2-1ddf9f104d0d service nova] Creating event network-vif-deleted:b846ee16-d1e4-4a62-87e1-a9c1e7a9ecf7 for instance 9c86702d-1cc3-43e7-953f-27a9779a3f21 on hv-cinder-82758 Feb 03 03:08:52.958148 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-9edb4a28-f8ac-47ce-b5b9-cf23b4fe6b39 req-5adc721b-b7ca-4424-a1b2-1ddf9f104d0d service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029768 Feb 03 03:08:52.958970 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 499/1031] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:08:53.330472 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-c16d26ab-388f-4ba7-a03c-14278c4675cf tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:08:53.331079 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-c16d26ab-388f-4ba7-a03c-14278c4675cf tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 9c86702d-1cc3-43e7-953f-27a9779a3f21] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:08:53.337539 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c16d26ab-388f-4ba7-a03c-14278c4675cf tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:08:53.337983 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c16d26ab-388f-4ba7-a03c-14278c4675cf tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:08:53.339039 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c16d26ab-388f-4ba7-a03c-14278c4675cf tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:08:53.339390 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c16d26ab-388f-4ba7-a03c-14278c4675cf tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:08:53.372441 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c16d26ab-388f-4ba7-a03c-14278c4675cf tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:08:53.372914 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-c16d26ab-388f-4ba7-a03c-14278c4675cf tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:08:53.373360 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.objects.instance [None req-c16d26ab-388f-4ba7-a03c-14278c4675cf tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lazy-loading 'fault' on Instance uuid 9c86702d-1cc3-43e7-953f-27a9779a3f21 {{(pid=116386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 03 03:08:53.414189 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-c16d26ab-388f-4ba7-a03c-14278c4675cf tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:08:53.421555 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-c16d26ab-388f-4ba7-a03c-14278c4675cf tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21" status: 200 len: 1231 microversion: 2.1 time: 0.094839 Feb 03 03:08:53.422105 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 533/1032] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:08:53 2022] GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21 => generated 1231 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:08:54.439408 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-5f294e62-0964-4a6a-b7cc-486eacda950f tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:08:54.440139 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-5f294e62-0964-4a6a-b7cc-486eacda950f tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 9c86702d-1cc3-43e7-953f-27a9779a3f21] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:08:54.446769 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5f294e62-0964-4a6a-b7cc-486eacda950f tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:08:54.447209 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5f294e62-0964-4a6a-b7cc-486eacda950f tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:08:54.447973 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5f294e62-0964-4a6a-b7cc-486eacda950f tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:08:54.448399 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-5f294e62-0964-4a6a-b7cc-486eacda950f tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:08:54.463116 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.wsgi [None req-5f294e62-0964-4a6a-b7cc-486eacda950f tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] HTTP exception thrown: Instance 9c86702d-1cc3-43e7-953f-27a9779a3f21 could not be found. Feb 03 03:08:54.463683 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-5f294e62-0964-4a6a-b7cc-486eacda950f tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Returning 404 to user: Instance 9c86702d-1cc3-43e7-953f-27a9779a3f21 could not be found. {{(pid=116385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 03:08:54.464483 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-5f294e62-0964-4a6a-b7cc-486eacda950f tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21" status: 404 len: 111 microversion: 2.1 time: 0.029707 Feb 03 03:08:54.465389 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 500/1033] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:08:54 2022] GET /compute/v2.1/servers/9c86702d-1cc3-43e7-953f-27a9779a3f21 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 03:08:57.578075 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-eeb5e9f0-b759-46ec-8180-507d2df11478 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:08:57.578637 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-eeb5e9f0-b759-46ec-8180-507d2df11478 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 6ab6ad78-2698-4a09-a9a5-49fa4e597aa3] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:08:57.578976 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-0c9c776b-7391-4c3b-a556-9600530d4fed req-42bc0ac3-b8e7-4de9-ad2b-adcbba2e081f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ab6ad78-2698-4a09-a9a5-49fa4e597aa3", "tag": "a9ba86bb-26b3-4ebd-ac40-8804b29ecd9c"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:08:57.580686 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:08:57.580686 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:08:57.587018 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-eeb5e9f0-b759-46ec-8180-507d2df11478 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:08:57.587478 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-eeb5e9f0-b759-46ec-8180-507d2df11478 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:08:57.588237 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-eeb5e9f0-b759-46ec-8180-507d2df11478 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:08:57.588971 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-eeb5e9f0-b759-46ec-8180-507d2df11478 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:08:57.589092 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-0c9c776b-7391-4c3b-a556-9600530d4fed req-42bc0ac3-b8e7-4de9-ad2b-adcbba2e081f service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:08:57.589450 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-0c9c776b-7391-4c3b-a556-9600530d4fed req-42bc0ac3-b8e7-4de9-ad2b-adcbba2e081f service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:08:57.601842 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-0c9c776b-7391-4c3b-a556-9600530d4fed req-42bc0ac3-b8e7-4de9-ad2b-adcbba2e081f service nova] Creating event network-changed:a9ba86bb-26b3-4ebd-ac40-8804b29ecd9c for instance 6ab6ad78-2698-4a09-a9a5-49fa4e597aa3 on hv-cinder-82758 Feb 03 03:08:57.607396 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-0c9c776b-7391-4c3b-a556-9600530d4fed req-42bc0ac3-b8e7-4de9-ad2b-adcbba2e081f service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032823 Feb 03 03:08:57.607993 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 501/1034] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:08:57.775474 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-eeb5e9f0-b759-46ec-8180-507d2df11478 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 6ab6ad78-2698-4a09-a9a5-49fa4e597aa3] Going to try to terminate instance {{(pid=116386) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 03 03:08:57.857495 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-eeb5e9f0-b759-46ec-8180-507d2df11478 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "DELETE /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3" status: 204 len: 0 microversion: 2.1 time: 0.283914 Feb 03 03:08:57.861260 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 534/1035] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Feb 3 03:08:57 2022] DELETE /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 03 03:08:57.869605 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-055235c7-8bde-451a-812a-9215f626490e tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:08:57.870433 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-055235c7-8bde-451a-812a-9215f626490e tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 6ab6ad78-2698-4a09-a9a5-49fa4e597aa3] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:08:57.877762 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-055235c7-8bde-451a-812a-9215f626490e tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:08:57.878548 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-055235c7-8bde-451a-812a-9215f626490e tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:08:57.879378 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-055235c7-8bde-451a-812a-9215f626490e tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:08:57.879763 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-055235c7-8bde-451a-812a-9215f626490e tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:08:58.102512 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.policy [None req-055235c7-8bde-451a-812a-9215f626490e tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116385) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:08:58.110738 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-055235c7-8bde-451a-812a-9215f626490e tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3" status: 200 len: 1578 microversion: 2.1 time: 0.245167 Feb 03 03:08:58.111487 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 502/1036] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:08:57 2022] GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3 => generated 1578 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:08:59.131216 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-910a1792-013e-4098-81d7-63c3c4f38a77 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:08:59.131907 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-910a1792-013e-4098-81d7-63c3c4f38a77 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 6ab6ad78-2698-4a09-a9a5-49fa4e597aa3] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:08:59.138571 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-910a1792-013e-4098-81d7-63c3c4f38a77 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:08:59.139015 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-910a1792-013e-4098-81d7-63c3c4f38a77 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:08:59.139794 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-910a1792-013e-4098-81d7-63c3c4f38a77 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:08:59.140215 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-910a1792-013e-4098-81d7-63c3c4f38a77 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:08:59.284741 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-910a1792-013e-4098-81d7-63c3c4f38a77 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:08:59.292642 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-910a1792-013e-4098-81d7-63c3c4f38a77 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3" status: 200 len: 1460 microversion: 2.1 time: 0.167553 Feb 03 03:08:59.293239 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 535/1037] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:08:59 2022] GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3 => generated 1460 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:08:59.844286 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [req-abd1bb3e-4390-45cd-8a5d-2a053d5a8c28 req-413b2969-8986-4ed9-ba1b-036fdc5abbab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ab6ad78-2698-4a09-a9a5-49fa4e597aa3", "name": "network-vif-deleted", "tag": "a9ba86bb-26b3-4ebd-ac40-8804b29ecd9c"}]} {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 03 03:08:59.845884 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 03 03:08:59.845884 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: warnings.warn(msg) Feb 03 03:08:59.853777 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-abd1bb3e-4390-45cd-8a5d-2a053d5a8c28 req-413b2969-8986-4ed9-ba1b-036fdc5abbab service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:08:59.854224 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [req-abd1bb3e-4390-45cd-8a5d-2a053d5a8c28 req-413b2969-8986-4ed9-ba1b-036fdc5abbab service nova] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:08:59.865887 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.compute.server_external_events [req-abd1bb3e-4390-45cd-8a5d-2a053d5a8c28 req-413b2969-8986-4ed9-ba1b-036fdc5abbab service nova] Creating event network-vif-deleted:a9ba86bb-26b3-4ebd-ac40-8804b29ecd9c for instance 6ab6ad78-2698-4a09-a9a5-49fa4e597aa3 on hv-cinder-82758 Feb 03 03:08:59.870911 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [req-abd1bb3e-4390-45cd-8a5d-2a053d5a8c28 req-413b2969-8986-4ed9-ba1b-036fdc5abbab service nova] 10.222.0.31 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030624 Feb 03 03:08:59.871500 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 503/1038] 10.222.0.31 () {64 vars in 1317 bytes} [Thu Feb 3 03:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 03 03:09:00.318783 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-d04b14b4-94f8-4058-8875-9c09b4899f24 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:09:00.319601 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-d04b14b4-94f8-4058-8875-9c09b4899f24 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 6ab6ad78-2698-4a09-a9a5-49fa4e597aa3] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:09:00.330301 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d04b14b4-94f8-4058-8875-9c09b4899f24 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:09:00.331040 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d04b14b4-94f8-4058-8875-9c09b4899f24 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:09:00.332319 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d04b14b4-94f8-4058-8875-9c09b4899f24 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:09:00.333078 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d04b14b4-94f8-4058-8875-9c09b4899f24 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:09:00.365707 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d04b14b4-94f8-4058-8875-9c09b4899f24 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:09:00.366193 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-d04b14b4-94f8-4058-8875-9c09b4899f24 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:09:00.366571 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.objects.instance [None req-d04b14b4-94f8-4058-8875-9c09b4899f24 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lazy-loading 'fault' on Instance uuid 6ab6ad78-2698-4a09-a9a5-49fa4e597aa3 {{(pid=116386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 03 03:09:00.408663 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.policy [None req-d04b14b4-94f8-4058-8875-9c09b4899f24 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a97115409ba4be989f9071c61df79a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '264ee2f5b580483c85a302041b05c23f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116386) authorize /opt/stack/nova/nova/policy.py:199}} Feb 03 03:09:00.416233 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-d04b14b4-94f8-4058-8875-9c09b4899f24 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3" status: 200 len: 1231 microversion: 2.1 time: 0.103624 Feb 03 03:09:00.417072 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 536/1039] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:09:00 2022] GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3 => generated 1231 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 03 03:09:01.438965 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-d69e8ffd-9894-4114-810c-76385c6528e3 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:09:01.440088 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-d69e8ffd-9894-4114-810c-76385c6528e3 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 6ab6ad78-2698-4a09-a9a5-49fa4e597aa3] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:09:01.447972 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d69e8ffd-9894-4114-810c-76385c6528e3 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:09:01.448407 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d69e8ffd-9894-4114-810c-76385c6528e3 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:09:01.449220 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d69e8ffd-9894-4114-810c-76385c6528e3 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:09:01.449644 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-d69e8ffd-9894-4114-810c-76385c6528e3 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:09:01.463073 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.wsgi [None req-d69e8ffd-9894-4114-810c-76385c6528e3 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] HTTP exception thrown: Instance 6ab6ad78-2698-4a09-a9a5-49fa4e597aa3 could not be found. Feb 03 03:09:01.463636 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-d69e8ffd-9894-4114-810c-76385c6528e3 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Returning 404 to user: Instance 6ab6ad78-2698-4a09-a9a5-49fa4e597aa3 could not be found. {{(pid=116385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 03:09:01.464435 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-d69e8ffd-9894-4114-810c-76385c6528e3 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3" status: 404 len: 111 microversion: 2.1 time: 0.033102 Feb 03 03:09:01.464977 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 504/1040] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:09:01 2022] GET /compute/v2.1/servers/6ab6ad78-2698-4a09-a9a5-49fa4e597aa3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 03:09:01.940189 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-356b7998-9583-4147-ad22-348bda8ce035 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:09:01.940803 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.compute.api [None req-356b7998-9583-4147-ad22-348bda8ce035 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 4cbae628-c830-4c00-9f73-83e7b4902acd] Fetching instance by UUID {{(pid=116386) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:09:01.946998 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-356b7998-9583-4147-ad22-348bda8ce035 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:09:01.947410 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-356b7998-9583-4147-ad22-348bda8ce035 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:09:01.948198 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-356b7998-9583-4147-ad22-348bda8ce035 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:09:01.948647 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG oslo_concurrency.lockutils [None req-356b7998-9583-4147-ad22-348bda8ce035 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:09:01.961915 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.wsgi [None req-356b7998-9583-4147-ad22-348bda8ce035 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] HTTP exception thrown: Instance 4cbae628-c830-4c00-9f73-83e7b4902acd could not be found. Feb 03 03:09:01.962496 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-356b7998-9583-4147-ad22-348bda8ce035 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Returning 404 to user: Instance 4cbae628-c830-4c00-9f73-83e7b4902acd could not be found. {{(pid=116386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 03:09:01.963329 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-356b7998-9583-4147-ad22-348bda8ce035 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "DELETE /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd" status: 404 len: 111 microversion: 2.1 time: 0.026975 Feb 03 03:09:01.963830 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 537/1041] 10.222.0.31 () {58 vars in 1238 bytes} [Thu Feb 3 03:09:01 2022] DELETE /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 03:09:01.972344 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-77e470a2-a983-4ee8-9a5a-181f672aad15 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '>' {{(pid=116385) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:09:01.973014 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.compute.api [None req-77e470a2-a983-4ee8-9a5a-181f672aad15 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] [instance: 4cbae628-c830-4c00-9f73-83e7b4902acd] Fetching instance by UUID {{(pid=116385) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 03 03:09:01.983287 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-77e470a2-a983-4ee8-9a5a-181f672aad15 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:09:01.984434 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-77e470a2-a983-4ee8-9a5a-181f672aad15 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:09:01.986405 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-77e470a2-a983-4ee8-9a5a-181f672aad15 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 03 03:09:01.987098 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG oslo_concurrency.lockutils [None req-77e470a2-a983-4ee8-9a5a-181f672aad15 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Lock "40cf0a47-7e1e-4d6b-9709-06f3170571bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116385) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 03 03:09:02.002573 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.wsgi [None req-77e470a2-a983-4ee8-9a5a-181f672aad15 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] HTTP exception thrown: Instance 4cbae628-c830-4c00-9f73-83e7b4902acd could not be found. Feb 03 03:09:02.003152 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: DEBUG nova.api.openstack.wsgi [None req-77e470a2-a983-4ee8-9a5a-181f672aad15 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Returning 404 to user: Instance 4cbae628-c830-4c00-9f73-83e7b4902acd could not be found. {{(pid=116385) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 03 03:09:02.003958 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO nova.api.openstack.requestlog [None req-77e470a2-a983-4ee8-9a5a-181f672aad15 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd" status: 404 len: 111 microversion: 2.1 time: 0.035334 Feb 03 03:09:02.004483 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: [pid: 116385|app: 0|req: 505/1042] 10.222.0.31 () {58 vars in 1235 bytes} [Thu Feb 3 03:09:01 2022] GET /compute/v2.1/servers/4cbae628-c830-4c00-9f73-83e7b4902acd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 03 03:09:03.318319 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: DEBUG nova.api.openstack.wsgi [None req-8300c69c-e515-4086-afe9-596ffae72ee0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] Calling method '.version_select at 0x7ff99ce5e430>' {{(pid=116386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 03 03:09:03.345567 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO nova.api.openstack.requestlog [None req-8300c69c-e515-4086-afe9-596ffae72ee0 tempest-TestVolumeBootPattern-1583680244 tempest-TestVolumeBootPattern-1583680244-project] 10.222.0.31 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1043137288" status: 202 len: 0 microversion: 2.1 time: 0.030792 Feb 03 03:09:03.346151 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: [pid: 116386|app: 0|req: 538/1043] 10.222.0.31 () {58 vars in 1262 bytes} [Thu Feb 3 03:09:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1043137288 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 03 03:09:56.049586 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 03 03:09:56.050544 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: Thu Feb 3 03:09:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 03 03:11:27.486851 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 03 03:11:27.488163 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: Thu Feb 3 03:11:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 03 03:11:35.799132 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 03 03:11:35.800059 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: Thu Feb 3 03:11:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 03 03:11:43.008304 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 03 03:11:43.009539 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: Thu Feb 3 03:11:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 03 03:11:53.592260 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 03 03:11:53.593522 dv-cinder-827581-1-iscsi devstack@n-api.service[116385]: Thu Feb 3 03:11:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 03 03:12:04.409268 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 03 03:12:04.410111 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: Thu Feb 3 03:12:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 03 03:13:16.062616 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 03 03:13:16.063746 dv-cinder-827581-1-iscsi devstack@n-api.service[116386]: Thu Feb 3 03:13:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!